Sasuke calling someone annoying is not a dealbreaker. He called Naruto annoying when he way on his to stop Itachi and he came across Naruto's shadow clone. He was talking about Naruto's persistence, which is how he knew it was a shadow clone, and annoyed that Naruto got in the way. However, you will never see us pretend that was a romantic moment. We have an actual term of endearment that holds weight which is usuratonkachi. Sasusaku fans have to recontextualize negative moments because they have nothing to fall back on. When Sasuke says something is annoying he means it.
yeah the point is that ss always twist sasuke's words/actions to sakura into pro ss romantic moments when they're really not. surely 'you're annoying' is used as a term of endearment. surely sasuke said this and did that because he loved her based on this single panel taken out of context etc you know how it goes.
He was talking about Naruto's persistence, which is how he knew it was a shadow clone, and annoyed that Naruto got in the way.
don't think sasuke knew it was a shadow clone just from that. but team taka knew that konoha was on their tails. and then karin said she sensed the same chakra around them, to which sasuke didn't look worried about.
so sasuke knew konoha was following him (naruto very likely included in that) which included someone with the same chakra which was all around them (naruto very likely, his shadow clown jutsu is his speciality). so naruto was a potential candidate.
and then when they finally did meet sasuke didn't look surprised. but he didn't know if it was a shadow clone or not, either was a possibility.
so sasuke got his chidori ready and came at naruto with enough time for naruto to yell out his name (which means that sasuke came at naruto with a speed that naruto could've dodged if he wanted), and if that was the real naruto he would've dodged or countered instead, but obviously that was not the point because that was a shadow clone and it needed to be dispelled to relay that info back to the original naruto.
and then sasuke says 'naruto ?' confirming what he suspected/thought.
of course sasuke doesn't use the term 'uzai' for naruto when describing naruto's persistence in chasing him - uzai is a vocabulary word he uses exclusively for sakura 🤭