Registering Container Instances did the trick.
I still can’t build on teh windows agent though because no .net framework 4.5.2. It would be really cool to have a container instance capable of building plain vanilla VS 2017 projects out of the box but in the absence of same, I guess that the managed image is the way forward in for me at this point.
Thanks for your input!