French privateering in the Gulf of Mexico: ended circa 1830
Conclusion: an adventuring party consisting of a Victorian gentleman thief, an Old West gunslinger, a disgraced former samurai, and an elderly French pirate is actually 100% historically plausible.