if your fish has lost color in just three weeks, I would say its likely that the breeder was prob feeding color enhancing food or your water is either harder/softer than what the breeder had. Three weeks is too short to lose coloration like that under normal conditions. Many breeders/vendors as a pesky bunch.
There is a detriment to feeding color enhancing foods when the fish are young. It takes years for a koi to "finish" or settle on its real colors. Stuff like color enhancing food force a koi to finish while young, which is a crying shame. Unfortunately, we as Americans have little patience with koi and want to buy the best and brightest colors in very young fish--which is really unreasonable. The japanese are much smarter and have way more patience, and may buy a young fish that might look dull as a tosai (yearling), but can see the signs that it will be brightly colored maybe after 5 or 6 years.
We Americans are a microwave society--and we want it fast, now, and brightly colored immediately. We don't like to wait. With koi, you need to let nature take its course. Rushing things only works against you and the fish.
Koiguy is right that UV/sun does affect colors.