{"id":1979,"date":"2020-04-24T08:14:06","date_gmt":"2020-04-24T06:14:06","guid":{"rendered":"http:\/\/www.datascience.rs\/?p=1979"},"modified":"2020-04-24T08:14:06","modified_gmt":"2020-04-24T06:14:06","slug":"upravljanje-tokom-obrade-podataka-koristeci-apache-airflow","status":"publish","type":"post","link":"http:\/\/imuno-srbija.com\/data-science\/en\/2020\/04\/24\/upravljanje-tokom-obrade-podataka-koristeci-apache-airflow\/","title":{"rendered":"Upravljanje tokom obrade podataka koriste\u0107i Apache Airflow"},"content":{"rendered":"<p>Upravljanje radnim tokovima postalo je uobi\u010dajena potreba ve\u0107ine kompanija koje automatizuju svoje procese obrade podataka. Ovi procesi moraju se izvoditi prema rasporedu i obi\u010dno imaju skup zavisnosti od drugih procesa. Uvek postoji jednostavni cron job za po\u010detak rada. Slede\u0107i korak napred su skripte koje pokre\u0107u druge skripte i to mo\u017ee da funkcioni\u0161e na kratko vreme. Zatim se pojavljuju jednostavni alati za re\u0161avanje problema poput skladi\u0161tenja statusa ovih procesa i njihovih zavisnosti. Obi\u010dno ova re\u0161enja rastu reaktivno, ali ne omogu\u0107avaju jednostavno skaliranje.<\/p>\n<p>\u0110or\u0111e Marjanovi\u0107 &#8211; data engineer u kompaniji <a href=\"https:\/\/contentinsights.com\/\" target=\"_blank\" rel=\"noopener\">Content Insights<\/a>, na Data Science Srbija Webinaru, odr\u017eanom 23. aprila, govorio je o upravljanju tokom obrade podataka koriste\u0107i Apache Airflow.<\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/uZT26sYJ0Hc\" width=\"560\" height=\"315\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>Fokus ove prezentacije je Apache Airflow platforma za kreiranje, izvr\u0161avanje i monitoring tokovima radnih procesa. Ovaj open-source alat omogu\u0107ava beskona\u010dno skaliranje i koriste ga kompanije kao \u0161to su Airbnb, Google, Lyft, PayPal i dr. U januaru 2019. godine progla\u0161en je za Top-Level projekat Apache Software Foundation. Cilj prezentacije je da se slu\u0161aoci upoznaju sa ovim alatom, njegovim mogu\u0107nostima i na\u010dinom funkcionisanja.\u00a0\u0110or\u0111e nam je pokazao i kako firma Content Insights koristi Airflow.<\/p>\n<p>&nbsp;<\/p>\n<!--themify_builder_content-->\n<div id=\"themify_builder_content-1979\" data-postid=\"1979\" class=\"themify_builder_content themify_builder_content-1979 themify_builder tf_clear\">\n    <\/div>\n<!--\/themify_builder_content-->","protected":false},"excerpt":{"rendered":"<p>\u0110or\u0111e Marjanovi\u0107 &#8211; data engineer u kompaniji Content Insights, na Data Science Srbija Webinaru, odr\u017eanom 23. aprila, govorio je o upravljanju tokom obrade podataka koriste\u0107i Apache Airflow.<\/p>","protected":false},"author":1,"featured_media":1980,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[25],"tags":[],"_links":{"self":[{"href":"http:\/\/imuno-srbija.com\/data-science\/en\/wp-json\/wp\/v2\/posts\/1979"}],"collection":[{"href":"http:\/\/imuno-srbija.com\/data-science\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/imuno-srbija.com\/data-science\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/imuno-srbija.com\/data-science\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/imuno-srbija.com\/data-science\/en\/wp-json\/wp\/v2\/comments?post=1979"}],"version-history":[{"count":0,"href":"http:\/\/imuno-srbija.com\/data-science\/en\/wp-json\/wp\/v2\/posts\/1979\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/imuno-srbija.com\/data-science\/en\/wp-json\/wp\/v2\/media\/1980"}],"wp:attachment":[{"href":"http:\/\/imuno-srbija.com\/data-science\/en\/wp-json\/wp\/v2\/media?parent=1979"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/imuno-srbija.com\/data-science\/en\/wp-json\/wp\/v2\/categories?post=1979"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/imuno-srbija.com\/data-science\/en\/wp-json\/wp\/v2\/tags?post=1979"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}