Transform columns from S3's Server Access Log Format into the more useful Combined Logfile Format. In the Unix world, we could easily pull this off with sed. In this case though, we might actually want to process each line by hand, since we still need to...
5. Concatenate and Sort records into a single file. There are lots of ways to accomplish this, and they're all a bit painful and slow. When I did this myself, I wrote a little combined transformer/sorter that spun through all the files at once and accomplished steps 4 and 5 in a single pass.
Identity Services: Authentication, authorization, and access to the service catalog.
Object Storage (Swift): Access to containers, objects, and all related services.
CDN (SOS): Edge-side caching of objects from Object Storage.
The inception of OpenPhoto was a desire to liberate our photos and take back control. Like you, our photos are the most valuable digital files we have. Also like you, we've used Flickr, Picasa and Smugmug and wound up with our photos scattered across numerous sites on the web.
We knew there had to be a better way to take, share and archive photos while retaining ownership. It didn't seem like anyone else was going to build it so we took it upon ourselves to solve this problem for everyone.