Keycaps are fairly straightforward to 3d print.

If that's not DIY enough you can make a mold and cast them from silicone (the method used by most artisan keycaps) or make them out of wood.