Nope - you don't need it to get in.  Yes, it expedites the process and it is preferred but it's the US that has mandated the Passport or other acceptable proof of citizenship for entry.  My wife and I use a passport while my kids have NEXUS cards.  So, your real problem isn't getting into Canada - it's getting out.