Darren - based on your description of the size of your beetles ("They are so big that they are really clumsy and slow"), the fact that their food preference is fruit, and most importantly it would be major news if there was a Japanese beetle infestation in California I think it is likely that you are dealing with the green fruit beetle (Cotinus mutabilis) also known as the fig beetle. Can you post some pics? This beetle is much larger than Japanese beetles at about 1 1/4" in length. Japanese beetles are 6/10" in length. Japanese beetles also have very distinctive white spots on the sides of their abdomen. If you'd been dealing with Japanese beetles all these years I'd think the agriculture people would have been in your area like a swarm of locusts.
The GFB is a very common beetle here in Arizona as well as much of the west and is a real pest on many fruits for a few weeks in normally late June into July here. They can really make a mess of peaches, nectarines, and plums to name a few of their favorites.
Both are scarab beetles and if memory serves David in Vietnam had quite a time with a couple of different scarab beetles eating blossoms last year for a few weeks. I have my annual few weeks dealing with at least 3 different species of rose chafers making mincemeat out of my rose blossoms. (also scarabs)
Here are links for each beetle:
http://en.wikipedia.org/wiki/Figeater_beetlehttp://en.wikipedia.org/wiki/Japanese_beetledave