Marketing data origin
We -as a marketing engineers- spend most of our time moving data around. We collect, reformat, and save data coming from multiple origins. It could be Google Trends serving data through a website, and then a python library storing the […]
100TB for $400/mo.
What’s the cheapest data storage? A file. Nothing beats a simple file. When you need to save data coming from an API, the minute you need to open a connection and stream the data to the database, you are consuming […]
Massive Data Migration Framework
Moving legacy data from a relational database to the cloud is becoming a common problem. Given that databases like MySQL degrade on performance as the data grows, they are being demoted to a simple configuration storage or debugging tools. If you […]
How much control should you give agencies over your data?
“If you’re you’re getting something off the shelf, you’re also getting the same data set your competitors might be getting.” Erin Matts, North American CEO at Annalect, Demystifying Agency Data Platforms The data platform tech behind agencies is pretty much […]
Data lakes power UIs, not engineers
“Data (…) is typically stored in a distributed file store that can hold high volumes of large files in various formats. This kind of store is often called a data lake.” Big data architectures Big data architectures are often designed backward: […]
Use SimpleDB for your Saved Reports
AWS SimpleDB is perfect for creating indexes and save small objects. Since it’s a NoSQL database, you can save game sessions with different attributes per user, or keeping inventory (and searching through) a large collection of s3 folders/files. In the […]
Tracking users is easy, but it is not cheap
There are a docent of user tracking tools in the market: Branch.io, Oribi, Mixpanel, even Facebook (if you use their pixel.) In fact, it is so easy that a desktop tracking implementation will take less than a day. As fun […]
Turning Data into Decisions
How do you go from a Facebook ad stats to a campaign update decision? Once your engineering team did all the heavy lifting of connecting with the channels Ads APIs, storing the data in a normalized format, and make it […]
AWS Data Transfer: an easy rule to save costs
Data storage has become so cheap that we don’t worry about how junk we are storing… until we get the first AWS bill with the spikes in data transfer. As a rule of thumb: it is like a flight ticket, […]
How to clean your data in 3 simple steps
As easy as it is to extract data from the web, there is a lot of noise out there. Data could be duplicated, irrelevant, inaccurate, incorrect, corrupt, or just don’t fit your analysis. How do you move from data quantity […]