I had something similar happen with an external pack I built. In the end I attributed it to losses in my usb cable/port...

However, if you inject the power into your contraption, at the same point, and you're able to measure the voltage at that point, and see the same voltage in both places... Then it's starting to get strange