{"id":3495,"date":"2018-05-13T16:57:44","date_gmt":"2018-05-13T13:57:44","guid":{"rendered":"https:\/\/www.almtoolbox.com\/blog_he\/?p=3495"},"modified":"2018-11-19T14:02:22","modified_gmt":"2018-11-19T12:02:22","slug":"streamsets-data-collector","status":"publish","type":"post","link":"https:\/\/www.almtoolbox.com\/blog_he\/streamsets-data-collector\/","title":{"rendered":"\u05db\u05d3\u05d0\u05d9 \u05dc\u05d4\u05db\u05d9\u05e8:  StreamSets Data Collector"},"content":{"rendered":"<p>\u05e2\u05d5\u05e1\u05e7\u05d9\u05dd \u05d1- Big Data? \u05db\u05d3\u05d0\u05d9 \u05dc\u05d4\u05db\u05d9\u05e8:<\/p>\n<p>StreamSets Data Collector \u05d4\u05d5\u05d0\u00a0\u05de\u05d5\u05e6\u05e8 \u05d4\u05db\u05ea\u05d5\u05d1 \u05d1\u05e7\u05d5\u05d3 \u05e4\u05ea\u05d5\u05d7,\u00a0 \u05d5\u05e0\u05d5\u05ea\u05df\u00a0\u05db\u05dc\u05d9 \u05dc\u05d4\u05e2\u05d1\u05e8\u05ea \u05de\u05d9\u05d3\u05e2 \u05e8\u05d1 \u05d1\u05e6\u05d5\u05e8\u05d4 \u05de\u05ea\u05de\u05e9\u05db\u05ea (continuous data pipelines) \u05d5\u05de\u05d4\u05d9\u05e8\u05d4 \u05d1\u05d9\u05df \u05db\u05dc\u05d9\u05dd \u05e0\u05e4\u05d5\u05e6\u05d9\u05dd, \u05dc\u05dc\u05d0 \u05e6\u05d5\u05e8\u05da \u05d1\u05db\u05ea\u05d9\u05d1\u05ea \u05e7\u05d5\u05d3 (\u05d0\u05da \u05e2\u05d3\u05d9\u05d9\u05df \u05e0\u05d9\u05ea\u05df \u05d2\u05dd \u05dc\u05d4\u05d5\u05e1\u05d9\u05e3 \u05e7\u05d5\u05d3 \u05d1\u05de\u05d9\u05d3\u05ea \u05d4\u05e6\u05d5\u05e8\u05da).<\/p>\n<p>\u05d4\u05de\u05d5\u05e6\u05e8 \u05de\u05d1\u05d5\u05e1\u05e1 \u05d2\u05d9\u05e8\u05e1\u05d0 \u05d7\u05d9\u05e0\u05de\u05d9\u05ea \u05d5\u05d2\u05d9\u05e8\u05e1\u05d0\u05d5\u05ea \u05d1\u05ea\u05e9\u05dc\u05d5\u05dd \u05d4\u05db\u05d5\u05dc\u05dc\u05d5\u05ea \u05ea\u05de\u05d9\u05db\u05d4 \u05e9\u05dc \u05d4\u05d9\u05e6\u05e8\u05df. \u05d4\u05de\u05d5\u05e6\u05e8 \u05de\u05ea\u05d0\u05d9\u05dd \u05dc\u05d4\u05ea\u05e7\u05e0\u05d4 \u05e4\u05e0\u05d9\u05dd-\u05d0\u05e8\u05d2\u05d5\u05e0\u05d9\u05ea (on-premises \/ self-hosted) \u05d5\u05de\u05ea\u05d0\u05d9\u05dd \u05d2\u05dd \u05dc\u05e8\u05e9\u05ea\u05d5\u05ea \u05e1\u05d2\u05d5\u05e8\u05d5\u05ea.<\/p>\n<p>\u05d4\u05de\u05d5\u05e6\u05e8 \u05de\u05d0\u05e4\u05e9\u05e8 \u05d4\u05e2\u05d1\u05e8\u05ea \u05db\u05de\u05d5\u05ea \u05d2\u05d3\u05d5\u05dc\u05d4 \u05e9\u05dc \u05de\u05d9\u05d3\u05e2 (Big Data) \u05de\u05de\u05d2\u05d5\u05d5\u05df \u05db\u05dc\u05d9\u05dd \u05d5\u05de\u05e7\u05d5\u05e8\u05d5\u05ea \u05de\u05d9\u05d3\u05e2, \u05d5\u05d0\u05dc \u05de\u05d2\u05d5\u05d5\u05df \u05db\u05dc\u05d9\u05dd, \u05d5\u05d1\u05e4\u05e8\u05d8 \u05d4\u05e2\u05d1\u05e8\u05ea \u05de\u05d9\u05d3\u05e2 \u05de\u05d5\u05d1\u05e0\u05d4 (\u05e8\u05dc\u05e6\u05d9\u05d5\u05e0\u05d9) \u05d0\u05dc \u05db\u05dc\u05d9 NoSQL \u05dc\u05d0-\u05e8\u05dc\u05e6\u05d9\u05d5\u05e0\u05d9\u05d9\u05dd.<\/p>\n<p>\u05dc\u05d3\u05d5\u05d2\u05de\u05d0: \u05d4\u05db\u05dc\u05d9 \u05de\u05d0\u05e4\u05e9\u05e8 \u05d4\u05e2\u05d1\u05e8\u05ea \u05de\u05d9\u05d3\u05e2 \u05de- database \u05e8\u05dc\u05e6\u05d9\u05d5\u05e0\u05d9 (relational database) \u05d0\u05dc\u00a0database \u05dc\u05d0 \u05e8\u05dc\u05e6\u05d9\u05d5\u05e0\u05d9 (non-relational database) &#8211; \u05dc\u05de\u05e9\u05dc \u05de- SQL\u00a0 \u05d0\u05dc MongoDB &#8212; \u05d5\u05d1\u05e7\u05dc\u05d5\u05ea \u05d9\u05d7\u05e1\u05d9\u05ea.<\/p>\n<p>&nbsp;<\/p>\n<h3>StreamSets Data Collector<\/h3>\n<p>\u05d4\u05db\u05dc\u05d9 \u05de\u05d0\u05e4\u05e9\u05e8 \u05dc\u05d4\u05d2\u05d3\u05d9\u05e8 data pipelines \u05d1\u05e6\u05d5\u05e8\u05d4 \u05d5\u05d9\u05d6\u05d5\u05d0\u05dc\u05d9\u05ea \u05d5\u05d2\u05dd \u05d1\u05e2\u05d6\u05e8\u05ea \u05e9\u05d5\u05e8\u05ea-\u05e4\u05e7\u05d5\u05d3\u05d4 (CLI). \u05e0\u05d9\u05ea\u05df \u05dc\u05d4\u05d2\u05d3\u05d9\u05e8 \u05de\u05e7\u05d5\u05e8\u05d5\u05ea (origins) \u05d5\u05d9\u05e2\u05d3\u05d9\u05dd (destinations) , \u05d5\u05db\u05df \u05e0\u05d9\u05ea\u05df \u05dc\u05d4\u05d2\u05d3\u05d9\u05e8 \u05ea\u05d4\u05dc\u05d9\u05db\u05d9\u05dd \u05dc\u05e2\u05d9\u05d1\u05d5\u05d3 \u05d4\u05de\u05d9\u05d3\u05e2 \u05d1\u05ea\u05d5\u05d5\u05da \u05e9\u05d1\u05d9\u05df \u05d4\u05de\u05e7\u05d5\u05e8\u05d5\u05ea \u05dc\u05d9\u05e2\u05d3\u05d9\u05dd, \u05db\u05d5\u05dc\u05dc \u05d0\u05e4\u05e9\u05e8\u05d5\u05d9\u05d5\u05ea \u05de\u05d5\u05d1\u05e0\u05d5\u05ea \u05dc\u05de\u05e0\u05d9\u05e4\u05d5\u05dc\u05e6\u05d9\u05d5\u05ea \u05e2\u05dc \u05d4\u05de\u05d9\u05d3\u05e2.<\/p>\n<p><a href=\"https:\/\/www.almtoolbox.com\/blog_he\/wp-content\/uploads\/2018\/09\/streamsets-data-collector.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-3502 alignnone\" src=\"https:\/\/www.almtoolbox.com\/blog_he\/wp-content\/uploads\/2018\/09\/streamsets-data-collector.jpg\" alt=\"StreamSets Data Collector\" width=\"670\" height=\"332\" srcset=\"https:\/\/www.almtoolbox.com\/blog_he\/wp-content\/uploads\/2018\/09\/streamsets-data-collector.jpg 821w, https:\/\/www.almtoolbox.com\/blog_he\/wp-content\/uploads\/2018\/09\/streamsets-data-collector-300x149.jpg 300w, https:\/\/www.almtoolbox.com\/blog_he\/wp-content\/uploads\/2018\/09\/streamsets-data-collector-768x381.jpg 768w\" sizes=\"auto, (max-width: 670px) 100vw, 670px\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<h3><\/h3>\n<h3>\u05e1\u05e7\u05d9\u05e8\u05d4 \u05e7\u05e6\u05e8\u05d4 \u05e2\u05dc \u05d4\u05de\u05d5\u05e6\u05e8 &#8211; \u05db\u05d5\u05dc\u05dc \u05d4\u05d3\u05d2\u05de\u05d4 \u05d8\u05db\u05e0\u05d9\u05ea \u05d5\u05db\u05ea\u05d5\u05d1\u05d9\u05d5\u05ea \u05e9\u05d4\u05d5\u05e1\u05e4\u05e0\u05d5 (\u05d6\u05de\u05df \u05e1\u05e8\u05d8\u05d5\u05df: 4 \u05d3\u05e7\u05d5\u05ea)<\/h3>\n<p><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/DBnfu-1jfBc?rel=0&amp;showinfo=0\" width=\"700\" height=\"393.75\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><span data-mce-type=\"bookmark\" style=\"display: inline-block; width: 0px; overflow: hidden; line-height: 0;\" class=\"mce_SELRES_start\">\ufeff<\/span><\/iframe><\/p>\n<p>&nbsp;<\/p>\n<h3>\u05de\u05e7\u05d5\u05e8\u05d5\u05ea \u05dc\u05e7\u05d1\u05dc\u05ea \u05de\u05d9\u05d3\u05e2 (Origins):<\/h3>\n<p style=\"direction: ltr;\">Kafka, Amazon S3, Kinesis, Hadoop, Cloudara, Hortonworks, MongoDB, JDBC Query Consumer ,File Tail, HTTP Client, FTP client, Redis Consumer, Salesforce, MySQL Binary Log, HTTP Server, Elastic (Elasticsearch), TCP Server, Google BigQuery, SQL Server Change Tracking, MapR, UDP Multithreaded Source, Windows Event Log<\/p>\n<p>&nbsp;<\/p>\n<h3>\u05d9\u05e2\u05d3\u05d9\u05dd \u05dc\u05d4\u05db\u05e0\u05e1\u05ea \u05de\u05d9\u05d3\u05e2 (Destinations):<\/h3>\n<p style=\"direction: ltr;\">Kafka Producer, Amazon S3, Cassandra, Kinesis Producer, Hadoop FS Apache, Cloudera, Hortonworks, Elastic (Elasticsearch), Flume, JDBC Producer, HBase, Hive Streaming, Solr, RabbitMQ, InfluxDB, Kinesis Firehose, MongoDB, Apache Kudu, MapR, Redis, Microsoft Azure HDInsight, Salesforce, Microsoft Azure Data Lake Store, Google Cloud Bigtable, HTTP Client, WebSocket Client, MQTT Publisher, CoAP Client, Azure Event Hub Producer, Google Pub\/Sub Publisher, Azure IoT Hub Producer, Google BigQuery, KineticaDB, Google Cloud Storage, Aerospike, Named Pipe<\/p>\n<p>&nbsp;<\/p>\n<h3>\u05d4\u05db\u05dc\u05d9 \u05ea\u05d5\u05de\u05da \u05d2\u05dd \u05d1\u05db\u05ea\u05d9\u05d1\u05ea \u05e7\u05d5\u05d3 &#8211; \u05d1\u05e9\u05e4\u05d5\u05ea \u05d4\u05d1\u05d0\u05d5\u05ea:<\/h3>\n<p style=\"direction: ltr;\">Java, JavaScript, Jython, Groovy,\u00a0\u00a0Java Expression Language (EL), Spark<\/p>\n<p>&nbsp;<\/p>\n<div class=\"alm-box alm-contact\">\n<div dir=\"rtl\"><\/div>\n<div dir=\"rtl\"><em>\u05d0\u05e0\u05d5 \u05e0\u05d5\u05ea\u05e0\u05d9\u05dd \u05e9\u05d9\u05e8\u05d5\u05ea \u05d9\u05e2\u05d5\u05e5 \u05dc\u05de\u05d5\u05e6\u05e8 \u2013 \u05ea\u05db\u05e0\u05d5\u05df, \u05d4\u05e7\u05de\u05ea \u05e1\u05d1\u05d9\u05d1\u05ea \u05e4\u05d9\u05d9\u05dc\u05d5\u05d8, \u05d4\u05d8\u05de\u05e2\u05d4, \u05d1\u05e0\u05d9\u05d9\u05ea pipelines, \u05d4\u05e2\u05d1\u05e8\u05d4 \u05dc- production, \u05de\u05db\u05d9\u05e8\u05ea \u05e8\u05d9\u05e9\u05d5\u05d9, \u05ea\u05de\u05d9\u05db\u05d4, \u05d4\u05d3\u05e8\u05db\u05d5\u05ea \u05d5\u05e2\u05d5\u05d3.<\/em><\/div>\n<div dir=\"rtl\">\u05d0\u05e0\u05d5 \u05e0\u05e6\u05d9\u05d2\u05d9 \u05d4\u05d7\u05d1\u05e8\u05d4 \u05d4\u05d9\u05d7\u05d9\u05d3\u05d9\u05dd \u05d1\u05d9\u05e9\u05e8\u05d0\u05dc \u05d5\u05d1\u05de\u05d3\u05d9\u05e0\u05d5\u05ea \u05e0\u05d5\u05e1\u05e4\u05d5\u05ea.<\/div>\n<div dir=\"rtl\"><em>\u05dc\u05e4\u05e8\u05d8\u05d9\u05dd \u05e0\u05d5\u05e1\u05e4\u05d9\u05dd:\u00a0 \u05d8\u05dc\u05e4\u05d5\u05df 072-240-5222 \u05d0\u05d5 \u05d1\u05de\u05d9\u05d9\u05dc:\u00a0<a href=\"mailto:devops@almtoolbox.com\">devops@almtoolbox.com<\/a><\/em><\/div>\n<div dir=\"rtl\"><\/div>\n<\/div>\n<h3>\u05e7\u05d9\u05e9\u05d5\u05e8\u05d9\u05dd \u05e8\u05dc\u05d1\u05e0\u05d8\u05d9\u05dd:<\/h3>\n<ul>\n<li>\u05d0\u05ea\u05e8 \u05d4\u05d9\u05e6\u05e8\u05df &#8211;\u00a0<a href=\"https:\/\/streamsets.com\/connectors\" target=\"_blank\" rel=\"noopener\">Data Collector<\/a><\/li>\n<li><a href=\"https:\/\/www.almtoolbox.com\/blog_he\/buy-software-licenses\/\" target=\"_blank\" rel=\"noopener\">\u05de\u05d5\u05e6\u05e8\u05d9\u05dd \u05e0\u05d5\u05e1\u05e4\u05d9\u05dd \u05d5\u05e9\u05d9\u05e8\u05d5\u05ea\u05d9\u05dd \u05e0\u05d5\u05e1\u05e4\u05d9\u05dd \u05e9\u05d0\u05e0\u05d5 \u05de\u05e6\u05d9\u05e2\u05d9\u05dd<\/a><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u05e2\u05d5\u05e1\u05e7\u05d9\u05dd \u05d1- Big Data? \u05db\u05d3\u05d0\u05d9 \u05dc\u05d4\u05db\u05d9\u05e8: StreamSets Data Collector \u05d4\u05d5\u05d0\u00a0\u05de\u05d5\u05e6\u05e8 \u05d4\u05db\u05ea\u05d5\u05d1 \u05d1\u05e7\u05d5\u05d3 \u05e4\u05ea\u05d5\u05d7,\u00a0 \u05d5\u05e0\u05d5\u05ea\u05df\u00a0\u05db\u05dc\u05d9 \u05dc\u05d4\u05e2\u05d1\u05e8\u05ea \u05de\u05d9\u05d3\u05e2 \u05e8\u05d1 \u05d1\u05e6\u05d5\u05e8\u05d4 \u05de\u05ea\u05de\u05e9\u05db\u05ea (continuous data pipelines) \u05d5\u05de\u05d4\u05d9\u05e8\u05d4 \u05d1\u05d9\u05df \u05db\u05dc\u05d9\u05dd \u05e0\u05e4\u05d5\u05e6\u05d9\u05dd, \u05dc\u05dc\u05d0 \u05e6\u05d5\u05e8\u05da \u05d1\u05db\u05ea\u05d9\u05d1\u05ea \u05e7\u05d5\u05d3 (\u05d0\u05da \u05e2\u05d3\u05d9\u05d9\u05df \u05e0\u05d9\u05ea\u05df \u05d2\u05dd \u05dc\u05d4\u05d5\u05e1\u05d9\u05e3 \u05e7\u05d5\u05d3 \u05d1\u05de\u05d9\u05d3\u05ea \u05d4\u05e6\u05d5\u05e8\u05da). \u05d4\u05de\u05d5\u05e6\u05e8 \u05de\u05d1\u05d5\u05e1\u05e1 \u05d2\u05d9\u05e8\u05e1\u05d0 \u05d7\u05d9\u05e0\u05de\u05d9\u05ea \u05d5\u05d2\u05d9\u05e8\u05e1\u05d0\u05d5\u05ea \u05d1\u05ea\u05e9\u05dc\u05d5\u05dd \u05d4\u05db\u05d5\u05dc\u05dc\u05d5\u05ea \u05ea\u05de\u05d9\u05db\u05d4 \u05e9\u05dc \u05d4\u05d9\u05e6\u05e8\u05df. \u05d4\u05de\u05d5\u05e6\u05e8 \u05de\u05ea\u05d0\u05d9\u05dd \u05dc\u05d4\u05ea\u05e7\u05e0\u05d4 \u05e4\u05e0\u05d9\u05dd-\u05d0\u05e8\u05d2\u05d5\u05e0\u05d9\u05ea (on-premises \/ self-hosted) [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":3502,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[291,295,60],"tags":[296,292,294,298,297],"class_list":["post-3495","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-big-data","category-dataops","category-devops","tag-aws-glue","tag-data-pipelines","tag-databases","tag-etl","tag-talend"],"_links":{"self":[{"href":"https:\/\/www.almtoolbox.com\/blog_he\/wp-json\/wp\/v2\/posts\/3495","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.almtoolbox.com\/blog_he\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.almtoolbox.com\/blog_he\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.almtoolbox.com\/blog_he\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/www.almtoolbox.com\/blog_he\/wp-json\/wp\/v2\/comments?post=3495"}],"version-history":[{"count":0,"href":"https:\/\/www.almtoolbox.com\/blog_he\/wp-json\/wp\/v2\/posts\/3495\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.almtoolbox.com\/blog_he\/wp-json\/wp\/v2\/media\/3502"}],"wp:attachment":[{"href":"https:\/\/www.almtoolbox.com\/blog_he\/wp-json\/wp\/v2\/media?parent=3495"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.almtoolbox.com\/blog_he\/wp-json\/wp\/v2\/categories?post=3495"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.almtoolbox.com\/blog_he\/wp-json\/wp\/v2\/tags?post=3495"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}