All cavers should have a few basic items to safely and comfortably enjoy going underground.
Like with most hobbies, there are as many gear opinions as there are cavers. Try out the basics and see what you like before making expensive specialized purchases.
Some popular items are recommended below:
Going on your first-ever beginner trip to a horizontal cave? Pick these up at any sports store:
Helmet: Unlike bicycle helmets, caving/climbing helmets are built to take impacts (e.g. rockfall) from above. The most popular helmets are the Petzl Boreo and the Black Diamond Half Dome.
Headlamp: You need TWO light sources mounted on your helmet, with a third in your pack. Your phone doesn't count!
Cheap camping headlamps (e.g. Black Diamond) are fine for beginner trips/smaller caves.
Kneepads: Expect to crawl on dry stone and gravel in your first California cave. Generic volleyball or construction kneepads are perfect for this. Avoid skater-style kneepads: hard plastic caps may get caught on rocks.
Elbow Pads (optional): Like kneepads, generic elbow pads are fine at first. Many cavers don't bother with elbow pads, as they tend to get snagged on rocks and make tight squeezes difficult.
Gloves: Keep your hands clean and protected! Gardening gloves or rubber kitchen gloves are common.
Clothes: Hopefully a given. Beginner caves are typically in the mid-50's F, so regular pants and a top are plenty. Have a layer or two in your bag just in case.
Bear in mind that anything you wear caving will eventually be torn into dirty shreds.
Once you've done a few caves you may want to make some upgrades:
Headlamp: Want to actually see the other side of that big cave? Check out Fenix, Nitecore, and Zebralight.
Look for L-shaped lights that use rechargable 18650 batteries for compatibility with other cavers' systems.
Kneepads: Specifically made for caving, Dirty Dave's, PMI Crawlers, and OR1 Howitzers are more likely to stay in place while crawling.
Gloves: If you're doing ropework, get some cut-resistent or leather climbing gloves.
Bag: Carry critical supplies (like lunch) into the cave. The REI Flash 22 is lightweight, holds everything you need for a daytrip, and is cheap enough that you won't be sad when it eventually disintegrates.
Hardcore cavers frequently use either a Swaygo or Petzl Speleo.
First Aid: Accidents happen and medical services are a long way away. Besides the standard gauzes, ointments, and pain relievers, grab some Sam Splints and assemble your own Palmer Furnace with a trash bag, some candles, and a lighter.
Cave Suit: If you're reading this, you probably don't need a cave suit yet. You'll know when you need one, and by then should know cavers who own various models and can offer advice specific to you.
That said, they'll probably recommend Adventure Vertical, Landjoff, or Minus90