Tell your boss too. I told a boss that I’d been offered 25% more elsewhere which was enough for me to take it unless he wanted to match it, he did.