The blue mold is being taken over by another mold, kind of dull brown, if I flake it away however it appears it is adhered to a blue layer. Can I remove the outer layer without effecting the inner cheese. Is this mold something to worry about?

Not being a moldy cheese maker, I can’t speak authoritatively.  However, if it’s not the mold you want, you need to get rid of it.  Wash it with a cloth dampened with brine or vinegar.  That takes care of most everything.  Maybe our resident mold man, Neil, will pitch in for a more professional opinion.

As Rich mentioned, Salt/Vinegar to get rid of unwanted mold. A picture would hlep, its the black/grey stuff you need to worry about, you can take a knife and cut of the sections you dont want then apply salt. Hope this helps

Photo of mold.

Looks more like orange, like washed cheese, or is that the cheese underneath ,,

That is some blue mold and the orange mold that is taking over.

“Orange” mold not wanted, sprinkle salt on it (sea salt pref) and see what happens, you might be dealing with a contamination. How is the air flow, needs to breath and have good Fresh Air Exchange.

It is in a small wine fridge and not in a container. 75% humidity, 50 degrees. I rubbed salt on one side of the orange mold. I noticed on the other blue cheese, most of the orange is gone and back to blue. Maybe the lowering of the humidity weakened the orange mold?

Too much humidity can encourage mold. Orange mold at least the Good one is produced by washing the cheese every day and the cheese becomes Orange.