Would you be ok if they went back to the Milky Way?

I disagree.  I don't think taking the series back to the Milky Way without tying up some of the loose ends in Andromeda would be beneficial in any way whatsoever.  The thing they have to do is up the bar on their animations, their writing and even their gameplay.  While I don't find any of it bad at all, others have... so they really have to outdo themselves to win those people back.  If they just go back to the Milky Way and nothing else really changes, all they do is lose any new people who have come along and happen to be into this story in Andromeda, and have formed an attachment to Ryder without ever having known Shepard at all.

Where they really, really have to up their game is in how they went about presenting this game pre-release.  The public will have absolutely no tolerance for any animation issues or other bugs... so the next one will have to be squeaky clean at release.  Of course, all of this depends on whether or not they even will want to try to release another Mass Effect game.  After what the company has been drug through by the public for the last, now 2, ME games, I wouldn't blame them if they just never try another again and move their focus onto other things.

They need to finish the Andromeda, along with Ryder's, story if they plan on continuing with the Mass Effect franchise. They established the base of a new narrative and direction for Mass Effect and they need to finish the story.

As for returning to the Milky Way, I'm good with using the Destroy ending and they either let Shepard live and go from there or he/she dies and there is a new protagonist set in the same galaxy.

Before that though, they need to conclude ME:A.

The issues with ME:A had little to nothing to do with the change of setting to be honest, and I would rather see them finish out the story arc they started.

It is not easy, because a few memes caused people to declare how bad the overall animations for Andromeda were bad can you imagine what kind of internet uproar there would be because "BioWare said my choice didn't matter" you saw that even in Mass Effect 3 with some of the choices they brought forward.  There is no way something like that wouldn't be a PR disaster for a very vocal group of people would take it and run with it even if they don't buy the game.

The location isn't the problem. Neither is the protagonist. The problem was some iffy writing at times and some poorly done graphics. Even though some of this stuff has been addressed, there's some deeply entrenched hate. Tbh, I think I'd like some dlc and at least an MEA2. Yeah, I'm not playing at the moment, because I'm unhappy about some things. However, I think BioWare is very much aware of the things people don't like. I feel that we might get some tighter writing in a dlc and an overall better game in MEA2. So, yes, move forward. All the reasons for not staying in the MW still remain. I guarantee you that choosing a canon ending for ME3 will not make things better with fans.

I'm torn between "no" and "fuck no"...

I never get why people keep mentioning the First Contact War as a setting for a new mass effect game. 

Putting aside the questions about whether anyone actually wanted a prequel, lets think about it.

Take ME1. Maybe spruce up the graphics and the control systems. Have a fraction of the weapons and gadgets of ME3. Have no biotics. Have no aliens besides the turians. Set the whole thing on a single planet and have it last 10 hours. Voila. Your successor to the OT, ladies and gentlemen.

The reality is the FCW was only notable because it was a First Contact scenario for humanity. It lasted a few days and resulted in a couple of hundred casualties. While this would be great for a random DLC for one of the earlier games, this isn't material for a modern Mass Effect game.

Although I like the Andromeda setting so far and definitely want Ryder to return for a continuation of that story, I don't think the arguments for returning to the Milky Way should be discarded so readily. There's something to be said for being able to travel to the Sol system and know that this is real, this is where I am, these are the planets that revolve around the same star that's shining outside my window. We got to drive around on our own little moon - can you honestly say that there wasn't anything special about seeing Earth hanging above the horizon? I enjoyed that immensely, at least. Knowing we were in this big galactic community of which the birthplace of our species was a tiny corner certainly made me care at least a little more. Probably a lot.

And even if you don't give a toss about any real-world connections, what about the fictitious places? Is there no value in being able to revisit Illium, Omega, the Citadel, the rare spots of green on Tuchanka? These places we've come to know (and, for some of us, love), is there no worth in seeing them again? I think there is. Discover new places, sure, but having an anchor to old ones certainly doesn't hurt either. (ME:A ending spoiler incoming:) That's what I think they're trying to establish with e.g. the human Ark crashing at the end of the game... A kind of homebase for us there. And it could be, eventually, but with three games and lots of DLC preceding ME:A I currently feel more attached to that universe.

What difference would it make, you ask? A world of difference, I think. Several worlds of difference, in fact. We've thrown away a dozen homeworlds and all relevance to their histories... all to avoid an ill-thought-out ending.

Not next game because I want them to finish the megastory they have started with Andromeda, but some point in the future I would love for them to return to the Milky Way.

What do you mean "fiasco"? That was great, so much so that it made its way into the game proper!

Wait what sweat fiasco?