caliper holder bolt ????

[mehigh]

i recently replaced the pads but in the process mistakenly loosened what the service manual calls the "caliper holder"
it wasn't very tight to begin with but now it will only tighten when i press the the entire caliper assembly together before mounting and becomes loose again when i do remount it to the bike
can i replace just the bolt and nut or do i need a new caliper