Have any temp/contract workers had phone calls like this?

You submit your CV for a job on the web, a "consultant" rings you up.
After a brief preamble about the "job" they want to put you forward
for the "consultant" then starts going backwards through your CV
asking for the name of:
"Who did you work under there?"
"What was the name of your manager?"
"Can you give me reference at that company?"
If you query their queries it's:
"I have to ask this on behalf of our client as we have a Service Level
Agreement with them"
Obviously the caller is only interested in what they can get out of
you for their own canvassing, so that he/she can ring these new
contacts (that you have generously provided) and give them a sales
pitch on the agency services.

This has several effects:
1) If I give genuine names for my refs and managers they get plagued
with agency phone calls canvassing for business.
2) The caller had no intention of putting me forward for a job
3) My time is wasted (and worse if I made and paid for the phone call)

Question is how do we react to these cowboys? Go along with it and be
a sucker? Or hang up saying "Take my name & CV off your database" and
reduce your chances of getting a job?

I can name the agency if anyone is interested, they tried the same
stunt twice in two months, so much for their own record-keeping, with
the second call I saw it a mile off and gave them false referee-names,

Gissajob