First off, I'd not copy stuff from OvalPortrayal2D unless you have to. Just subclass your agents from OvalPortrayal2D. Then you can say:
public final void draw(Object object, Graphics2D graphics, DrawInfo2D info) {
if (answer)
graphics.setColor(rightAnswer);
else
graphics.setColor(badAnswer);
super.draw(object, graphics, info);
}