“My OpenAI credits got hugged to death, please use a known postcode (like one from Keir Starmer’s constituency, WC2B6NH) in the meantime,” the author asks.
While the OSA is dumb, this is also bad design, and why applications are going to use so much power.
Cache the image creation results. Use a random address generator. This would drop the LLM use to the bare minimum.
They’re using ChatGPT for fake address generation if it even needs a cache for that part. There are plenty of libraries to do that locally. They should only need to cache generated images, which is the only thing a model would be useful for here.
While the OSA is dumb, this is also bad design, and why applications are going to use so much power.
Cache the image creation results. Use a random address generator. This would drop the LLM use to the bare minimum.
That’s…exactly what they are doing and telling you to use a known post code so you hit the cache…
They’re using ChatGPT for fake address generation if it even needs a cache for that part. There are plenty of libraries to do that locally. They should only need to cache generated images, which is the only thing a model would be useful for here.