With a stout taproot and hairs on the leaf stalk pointing up this is Oxalis perennans. To ID Oxalis, you often need to get a photo of the leaf like stipules on the inside if the bases of the leaves, or the lack thereof. Photos of reasonably mature seed cases are often a clincher. You need a permit to pull up native species, of which this is one. What you can do instead is get good photos of the other features. These are often enough for a definite ID.
Most yellow Oxalis are native. The commoner weed, Oxalis corniculata, has very obvious square topped stipules at the bases of the leaf stalks. It has no taproot and roots at the nodes. https://keys.lucidcentral.org/keys/v3/plants_se_nsw/key/plants_se_nsw/Media/Html/entities/oxalis_corniculata.htm