James Bond might have to cancel that Caribbean vacation: British officials say time off for some who work at the MI5 and MI6 security agencies will be restricted during the London Olympics.

But two government officials denied British media reports that there would be a blanket ban on vacations until the games end in August at Britain's foreign spy agency, MI6, and its domestic security agency, MI5. The officials spoke on condition of anonymity because of the sensitivity of their jobs.

Officials said Thursday the leaves will be restricted for people working in key counterterrorism roles and in other operations for the July 27-Aug. 12 games. U.K. officials say there has been no intelligence of a specific threat to the games, but they are planning to raise the threat level protectively.