how about matching pre recorded samples to syllables or other basic building blocks of a word? that would make much more sense

so hello would be made up of 2 samples. one for hell and one for o.
sure there would be different samples for the same syllable since hell may not always sound the same depending on what comes after or before it. but i'm sure a system could be worked out.