IMO, once you take investment money, your choices become more limited in terms of balancing other factors versus company performance. Even if your investors don't demand it, you have an obligation to take actions that maximize their investment.
That said, even if they're not the right people now, can they grow into the right people? If so, that might be the best solution! Hopefully, you had a conversation with your co-founders about what taking investment money might mean in terms of future roles.