Pre-Amalgam days, I had lists that were more concise on number. I think you are right that this is probably the card causing dead weight.
List from 3 years ago that has 49, but was a fairly consistent turn 2, and has a decent main deck manabase: https://www.mtgtop8.com/event?e=11771&d=267126&f=VI
Could be cleaned up a bit with a smaller return package that's not using 6 slots on dread return targets.
This slightly earlier incarnation had 41: https://www.mtgtop8.com/event?e=11679&d=266568&f=VI
And could also easily be cleaned up below that without double bridge, and 5 slots on dread return targets.
Killing people with Hermit Druid post board were the days.