The answer to your question is no, it's not just about sex. That is the rationale presented by those recruiting disaffected young men into incel culture. Misyogyny is rooted in lifetimes of dominance-based culture of masculinity (Man Box) conditioning and shows up in large and small ways in marriages and relationships which include active sex lives.