Sounds to me like they hired a junior because they couldn't afford a senior, rather than because they actually wanted a junior (someone they can invest in and mentor until they become a senior). I have managed a team who had that decision forced upon them by managers who didn't know better.
He ended up with all sorts of unfortunate jobs like creating training videos for users and such and I still feel guilty about it now, but I was under pressure to deliver and the expectation was that adding a head to the development room would only speed things up.
It's unfortunate, because it puts you and your boss in tricky positions.
He probably doesn't have any work he can trust to a junior, and any seniors he might have can't be distracted from their day-to-day. The easy way out is to give the junior lots of non-development tasks, which he also doesn't really want to waste senior developers' time with.
But a few problems arise from this.
First, the kind of devops jobs he's giving you really require a senior developer. Particularly, a build server should be set up by someone who is building the software and knows where the pain-points are.
Second, the junior isn't becoming more useful. After five years of this, you'd still be doing the same tasks, because you still couldn't be trusted with actual development work.
Third, the junior will eventually (as you have) realise that they're not helping their own career. The assumption that juniors are low-quality, rather than low on (and looking for) experience is a terrible, but very common, mistake in this industry.
So, yes, sit down with your boss. But understand the predicament he's in. See if you can come to some arrangement which solves everybody's problems. You are going to need a senior mentor and some of your current tasks are going to need to be passed on to a senior. This will slow the project down but, in the long run, it will pay off. That's the point you need to get through to your boss, and possibly to their bosses. Also, see if you can find something you can offer in return to mitigate the costs.
If you can't then you might want to look elsewhere.