Perhaps all of this would be a lot easier if you actually built some simple automation to process requests. What could possibly take 3 days to process? The only plausible reason is that you’re wasting developers time on what really belongs in one of the myriad tools AWS itself provides for such tasks.
There’s nothing that’s simple when you’re dealing with 10s of thousands of different datasets across many different internal team and service boundaries with their own security setup depending on the data that’s being stored.
The cost of automating and properly securing it (since “gather all customer data into one place” is generally not great as it’s a single point of failure from a security perspective). All of that isn’t really worth it to spend the effort automating if the total number of requests for data is not that high.
