I have a 2004 Dutch catalog from an outdoor shop, which shows the then new Swiss Memory with 124 Mb USB stick.
Found a few of those brand new for sale here in Ukraine, both have a USB 2.0 memory and available with 16 or 32 Gb of storage. They cost 60-80$, which seems a little too expensive for an old sluggish USB 2.0 in my opinion
Early 21st century swissbit with 64MB and a red LED