Share 'Taking The Train To Southern California'

We're considering taking the kids on a train ride to San Diego instead of driving this summer. Looking on Amtrak.com, it looks like anything leaving from San Jose requires a bus ride--which we'd rather avoid with a 4 yr old and 7 yr old. Has anyone every taken the train south from here? Suggestions on routes or the best way to get there?