Judging from the top of the hairy stem, this could be Wahlenbergia gracilenta, relatively rarely photographed. Could you get good photos of the whole stem, including the leaves?
Just out of interest, what are some key diagnostic features of this species? I have seen perhaps 5 species around the ACT, and only know how to identify a couple.
Flora of the ACT mentions the small flowers and the shape and hairiness of the fruiting body. The easiest way to ID it is to pull it up and look at the root (only if you have a collecting permit). It is the only Wahlenbergia in the ACT that is an annual.