I enjoy building speakers, though the last pair I built was 15 years ago now, in the dark ages when DynAudio still sold drivers.
I'll build another pair next year when I build my studio. I'll probably do a D'Appolito design using Seas drivers, from
Madisound.
If you enjoy it (carpentry, design, etc) then I highly recommend it. Otherwise, just buy something. These days it's tricky to DIY and have it come out less than what is commercially available, especially once your time is factored in.