Yes. A decent one will cut off charging when cells are at designed max, DIY battery builders know how that works, or they should.
Even so, quality bare cells can take overvoltage. From the Lishen 21700 cell data sheet. You can short circuit them or overcharge to 6.3V.
9.1. External...