Does the order of sections in readme.txt matter?

Only header ( === Plugin name === ) and short description ( in that order ) must be on top. Other sections ( == section == ) can be placed in any order. Your == Changelog == can go just below short description, not higher.