Migrate Data Between Databases With One Job Using the Dynamic Schema

Migrate Data Between Databases With One Job Using the Dynamic Schema

"How can I migrate data from all tables from one database to another with one generic Talend Job......with transformations as well?" is a question I get again and again on Talend Community. As an integration developer with over 15 years of honing my skills, this question used to get me banging my head against my desk. I now sit at a desk with a subtle but definitely present dent, which is slightly discolored from classic pine to pine with a rosé tinge.

My attitude was always that Talend is a tool that helps developers build complex integration jobs and should be used by experts who realize that there is no universal, one-size-fits-all job for everything. However, I was being somewhat harsh and maybe somewhat elitist. Looking back at my frustrations, I can see that they came from the fact that I had spent a lot of time and energy building my expertise, and I was a little resentful of the expectation that what we integration experts do should be considered so trivial and easy.