Yes it is a bad idea. There are de facto standards on code organization in themes, and no one likes to figure out the code of someone else that thought that he is smarter than all WP developers before him, even if it is possible code wise to do it differently.
So unless you are planning to be the only one ever that works on that theme, please follow conventions and try to avoid inventing new ones.