I recently played in a game and one of the opposition was 78 years old, and he'd only recovered from bowel cancer a few weeks before! Ok, that's an exception rather than the rule, but you can carry on playing into your late 50's and early 60's in village cricket, no problems.
As for what to do to get involved, i'd suggest finding a local club who aren't playing in a competitive and good league and see if you can go along to evening practices. The season runs until September and then you're looking at winter nets, which most teams begin in the new year.
If you're super keen, look at getting some coaching, batting might be a better place to start than bowling - local sports centres or even someone at your local club mightbe able to help out.
And remember there is always a place for someone who can field in a team. So if you're reasonably fit, can catch, throw and stop a cricket ball you are a step futher on than many who play. A good fielder can be worth 20+ runs in a game. Many village teams will pick someone on their fielding alone.