Wild guess here, Scott--connecting rod nuts?
Regardless, if the engine was "running" albeit even a bit rough before you shut it down to change the oil, and you pulled THOSE things out of the oil pan, seems to me like you rebuild/send for rebuild that engine. If whatever those nuts were meant to hold lets loose when running you could easily destroy the engine by throwing a rod right through the wall of the engine, rendering it 100% useless. Consider yourself lucky to discover these metal pieces now as opposed to when the engine is running...