These men refers back to Gaius and Aristarchus of verse 29. Robbing temples and saying evil things about other gods were accusations often made against Jews during the New Testament period. Robbed temples is equivalent to “carried away holy things from temples.” Obviously no one would be accused of “robbing the whole building” in the sense of “carrying off a temple.”

Quoted with permission from Newman, Barclay M. and Nida, Eugene A. A Handbook on The Acts of the Apostles. (UBS Handbook Series). New York: UBS, 1972. For this and other handbooks for translators see here .