Yes it is possible but not exactly trivial or well documented. The easiest option is to have different comment types (ie, have new ones in addition to the traditional comment, pingback and tracback).
The biggest problem with this approach is that most of wordpress API and admin is not built to be flexible enough to sopprt different comments types, for example the recent comments widget might show all type or only one, and it might be hard to style them based on type.
But yes, that design is totally possible just requires more work and some dipper digging into the comments related apis.