{"id":146,"date":"2015-03-12T15:58:48","date_gmt":"2015-03-12T13:58:48","guid":{"rendered":"http:\/\/flexray.pl\/?p=146"},"modified":"2020-05-14T16:39:21","modified_gmt":"2020-05-14T14:39:21","slug":"big-data-aws-cloud","status":"publish","type":"post","link":"http:\/\/flexray.pl\/big-data-aws-cloud\/","title":{"rendered":"Big Data AWS Cloud"},"content":{"rendered":"<p><a href=\"http:\/\/chmurowisko.pl\/big-data-nie-jest-trudne\/\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter\" src=\"https:\/\/chmurowisko.pl\/wp-content\/uploads\/2015\/03\/Big-Data-Nie-Jest-Trudne-z-AWS-EMR.jpg\" alt=\"Big Data AWS\" width=\"680\" height=\"355\" \/><\/a><\/p>\n<p>Kolejny artyku\u0142 ze wzgl\u0119du na wysoko-chmurowy charakter trafi\u0142 na <a href=\"http:\/\/chmurowisko.pl\/big-data-nie-jest-trudne\/\">Chmurowisko.pl<\/a><br \/>\nZapraszam do lektury! Jest to kolejne wydanie przygotowania Hadoop, tym razem na Amazon Web Services wykorzystuj\u0105c mechanizmy Elastic Map Reduce.<\/p>\n<p><!--more--><\/p>\n<h3>Big Data AWS<\/h3>\n<p>Dla u\u0142atwienia przygotowa\u0142em 20-minutowe video pokazuj\u0105ce krok po kroku jak mo\u017cemy przygotowa\u0107 sobie \u015brodowisko Hadoop wykorzystuj\u0105c do tego wszystkie dobrodziejstwa chmury.<\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/oH63nyTcRcE\" width=\"420\" height=\"315\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>Jedyne r\u00f3\u017cnice w stosunku do poprzedniego artyku\u0142u <a href=\"http:\/\/flexray.pl\/ekspresowa-instalacja-hadoop-hive-pig\/\">Ekspresowa instalacja Hadoop, Hive, Pig<\/a> to kopiowanie wykonujemy bezpo\u015brednio z <strong>S3<\/strong> do <strong>HDFS<\/strong>, komenda b\u0119dzie nieco inna, podobnie jak lokalizacja docelowa w <strong>HDFS<\/strong> czyli \u201e\/tmp\u201d.<\/p>\n<pre class=\"brush: bash; title: ; notranslate\" title=\"\">\r\nhadoop distcp s3n:\/\/bigdatalab\/input\/Batting.csv hdfs:\/\/\/tmp\r\n<\/pre>\n<p>Dalsze kroki mo\u017cemy po prostu skopiowa\u0107 i wklei\u0107, pami\u0119taj\u0105c aby podmieni\u0107 \u015bcie\u017ck\u0119 <strong>HDFS<\/strong> z \u201e\/user\/root\u201d na \u201e\/tmp\u201d<\/p>\n<pre class=\"brush: bash; title: ; notranslate\" title=\"\">\r\nLOAD DATA INPATH '\/tmp\/Batting.csv' OVERWRITE INTO TABLE temp_batting;\r\n<\/pre>\n<p>Mo\u017cesz kontynuowa\u0107 przeklejanie z poprzedniego artyku\u0142u <a href=\"http:\/\/flexray.pl\/ekspresowa-instalacja-hadoop-hive-pig\/\">Ekspresowa instalacja Hadoop, Hive, Pig<\/a> lub spr\u00f3bowa\u0107 w\u0142asnych si\u0142.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Kolejny artyku\u0142 ze wzgl\u0119du na wysoko-chmurowy charakter trafi\u0142 na Chmurowisko.pl Zapraszam do lektury! Jest to kolejne wydanie przygotowania Hadoop, tym [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[12,24,25],"class_list":["post-146","post","type-post","status-publish","format-standard","hentry","category-bigdata","tag-aws","tag-big-data","tag-chmurowisko"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v14.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Big Data AWS Cloud - Flexray<\/title>\n<meta name=\"description\" content=\"Jest to kolejne wydanie przygotowania Hadoop czyli rozwi\u0105zania Big Data AWS wykorzystuj\u0105c mechanizmy Elastic Map Reduce w chmurze.\" \/>\n<meta name=\"robots\" content=\"index, follow\" \/>\n<meta name=\"googlebot\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta name=\"bingbot\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/flexray.pl\/big-data-aws-cloud\/\" \/>\n<meta property=\"og:locale\" content=\"pl_PL\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Big Data AWS Cloud - Flexray\" \/>\n<meta property=\"og:description\" content=\"Jest to kolejne wydanie przygotowania Hadoop czyli rozwi\u0105zania Big Data AWS wykorzystuj\u0105c mechanizmy Elastic Map Reduce w chmurze.\" \/>\n<meta property=\"og:url\" content=\"http:\/\/flexray.pl\/big-data-aws-cloud\/\" \/>\n<meta property=\"og:site_name\" content=\"Flexray\" \/>\n<meta property=\"article:published_time\" content=\"2015-03-12T13:58:48+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-05-14T14:39:21+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/chmurowisko.pl\/wp-content\/uploads\/2015\/03\/Big-Data-Nie-Jest-Trudne-z-AWS-EMR.jpg\" \/>\n<meta name=\"twitter:card\" content=\"summary\" \/>\n<meta name=\"twitter:creator\" content=\"@flexray\" \/>\n<meta name=\"twitter:site\" content=\"@flexray\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"http:\/\/flexray.pl\/#website\",\"url\":\"http:\/\/flexray.pl\/\",\"name\":\"Flexray\",\"description\":\"IT Services and Consulting\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"http:\/\/flexray.pl\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"pl-PL\"},{\"@type\":\"ImageObject\",\"@id\":\"http:\/\/flexray.pl\/big-data-aws-cloud\/#primaryimage\",\"inLanguage\":\"pl-PL\",\"url\":\"https:\/\/chmurowisko.pl\/wp-content\/uploads\/2015\/03\/Big-Data-Nie-Jest-Trudne-z-AWS-EMR.jpg\"},{\"@type\":\"WebPage\",\"@id\":\"http:\/\/flexray.pl\/big-data-aws-cloud\/#webpage\",\"url\":\"http:\/\/flexray.pl\/big-data-aws-cloud\/\",\"name\":\"Big Data AWS Cloud - Flexray\",\"isPartOf\":{\"@id\":\"http:\/\/flexray.pl\/#website\"},\"primaryImageOfPage\":{\"@id\":\"http:\/\/flexray.pl\/big-data-aws-cloud\/#primaryimage\"},\"datePublished\":\"2015-03-12T13:58:48+00:00\",\"dateModified\":\"2020-05-14T14:39:21+00:00\",\"author\":{\"@id\":\"http:\/\/flexray.pl\/#\/schema\/person\/5c55106ae0528899700cd7b427cdd780\"},\"description\":\"Jest to kolejne wydanie przygotowania Hadoop czyli rozwi\\u0105zania Big Data AWS wykorzystuj\\u0105c mechanizmy Elastic Map Reduce w chmurze.\",\"inLanguage\":\"pl-PL\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"http:\/\/flexray.pl\/big-data-aws-cloud\/\"]}]},{\"@type\":[\"Person\"],\"@id\":\"http:\/\/flexray.pl\/#\/schema\/person\/5c55106ae0528899700cd7b427cdd780\",\"name\":\"Maciej Stopa\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"http:\/\/flexray.pl\/#personlogo\",\"inLanguage\":\"pl-PL\",\"url\":\"http:\/\/0.gravatar.com\/avatar\/fc9e5f87bff4fd721f9f5c790edb2483?s=96&d=mm&r=g\",\"caption\":\"Maciej Stopa\"},\"sameAs\":[\"https:\/\/www.linkedin.com\/in\/maciejstopa\",\"https:\/\/twitter.com\/flexray\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"http:\/\/flexray.pl\/wp-json\/wp\/v2\/posts\/146"}],"collection":[{"href":"http:\/\/flexray.pl\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/flexray.pl\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/flexray.pl\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/flexray.pl\/wp-json\/wp\/v2\/comments?post=146"}],"version-history":[{"count":8,"href":"http:\/\/flexray.pl\/wp-json\/wp\/v2\/posts\/146\/revisions"}],"predecessor-version":[{"id":449,"href":"http:\/\/flexray.pl\/wp-json\/wp\/v2\/posts\/146\/revisions\/449"}],"wp:attachment":[{"href":"http:\/\/flexray.pl\/wp-json\/wp\/v2\/media?parent=146"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/flexray.pl\/wp-json\/wp\/v2\/categories?post=146"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/flexray.pl\/wp-json\/wp\/v2\/tags?post=146"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}