Yeah it is one of those things. Like when people are arrested in their own house and they find you have more than one gun. Even if your arrest was for something like too many speeding tickets, suddenly you are a heavily armed gun loving militia person on the news.
So you find a couple Eagle feathers in the woods and bring them home. Suddenly your neighbor finds out. Calls fish and game, they come to arrest you for being a Protected bird poacher and then they find you have guns and suddenly your in the news as a domestic terrorist hell bent on killing eagles with your arsenal of semi automatic weapons and RPGs. Don't matter if you have 50 Bibles in your house...No one will hear about that.
So I'd get rid of those feathers post haste. Don't tell anyone about them, Just stick them in a fire and get rid of the evidence. Don't give them to a Cop or fish and game guy either. Soon as they know you have them, you are a criminal, and they will make sure the world knows about it. Meanwhile they can't find the murderers in this State but they will find you for having a couple of ground found Eagle feathers.....Oh yeah they will.....