Trying to configure Logstash to use a proxy with LS_JAVA_OPTS but it doesn't seem to work -
elastic running on windows server 2012 r2 vm in azure. vm1: running in hyper-v on workstation windows server 2012 r2. no proxy vm2: setup in protected domain windows server 2012 r2; requires proxy
my logstash config (my.config) has output definition:
elasticsearch { host => "myhost.cloudapp.net" cluster => "mycluster" document_type => "%{type}" index => "%{index}_%{+yyyy.mm.dd}" template_name => "%{index}" document_id => "%{id}" protocol => "http" } vm1 can load data elastic search host fine zipped logstash folder vm1 , copied vm2 , extracted it. created start.bat file placed in \logstash\bin
cls set java_home=d:\jdk set ls_java_opts=-dhttp.proxyhost=myproxy.mydomain.com -dhttp.proxyport=8080 logstash.bat agent -f my.conf when running on vm2, following produced in command prompt window:
io/console not supported; tty not manipulated failed install template: connect timed out {:level=>:error} logstash startup completed got error send bulk of actions: connect timed out {:level=>:error} failed flush outgoing items {:outgoing_count=>1, :exception=>#<manticore::timeout: connect timed out>, :backtrace=>["d:/logstash/vendor/bundle/jruby/1.9/gems/manticore-0.4.1-java/lib/manticore/response.rb:35:in `initialize'", "org/jruby/rubyproc.java:271:in `call'", "d:/logstash/vendor/bundle/jruby/1.9/gems/manticore-0.4.1-java/lib/manticore/response.rb:61:in `call'", "d:/logstash/vendor/bundle/jruby/1.9/gems/manticore-0.4.1-java/lib/manticore/response.rb:225:in `call_once'", "d:/logstash/vendor/bundle/jruby/1.9/gems/manticore-0.4.1-java/lib/manticore/response.rb:128:in `code'", "d:/logstash/vendor/bundle/jruby/1.9/gems/elasticsearch-transport-1.0.12/lib/elasticsearch/transport/transport/http/manticore.rb:71:in `perform_request'", "org/jruby/rubyproc.java:271:in `call'", "d:/logstash/vendor/bundle/jruby/1.9/gems/elasticsearch-transport-1.0.12/lib/elasticsearch/transport/transport/base.rb:190:in `perform_request'", "d:/logstash/vendor/bundle/jruby/1.9/gems/elasticsearch-transport-1.0.12/lib/elasticsearch/transport/transport/http/manticore.rb:54:in `perform_request'", "d:/logstash/vendor/bundle/jruby/1.9/gems/elasticsearch-transport-1.0.12/lib/elasticsearch/transport/client.rb:119:in `perform_request'", "d:/logstash/vendor/bundle/jruby/1.9/gems/elasticsearch-api-1.0.12/lib/elasticsearch/api/actions/bulk.rb:80:in `bulk'", "d:/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-1.0.1-java/lib/logstash/outputs/elasticsearch/protocol.rb:103:in `bulk'", "d:/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-1.0.1-java/lib/logstash/outputs/elasticsearch.rb:505:in `submit'", "d:/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-1.0.1-java/lib/logstash/outputs/elasticsearch.rb:529:in `flush'", "d:/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.20/lib/stud/buffer.rb:219:in `buffer_flush'", "org/jruby/rubyhash.java:1341:in `each'", "d:/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.20/lib/stud/buffer.rb:216:in `buffer_flush'", "d:/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.20/lib/stud/buffer.rb:112:in `buffer_initialize'", "org/jruby/rubykernel.java:1511:in `loop'", "d:/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.20/lib/stud/buffer.rb:110:in `buffer_initialize'"], :level=>:warn} i tried logstash v1.5.0. updated logstash version in vm2 v1.5.2, not seem help.
i went "configure java" gui , setup proxy under network settings , didn't help. i'm using jdk version 1.8.0_45-b15.
i tried using http output plugin, did not work. here's logstash config that:
http { http_method => "post" url => "http://myhost.cloudapp.net/myindex/mytype" } the error getting (only copied exception message below).
:response=>nil, :exception=>#<errno::ebadf: bad file descriptor - bad file descriptor> it worth mentioning can use mozilla , internet explorer marvel sense plugin , can issue requests elastic search cluster. here's example request header fiddler:
get http://myhost.cloudapp.net:9200/_cat/indices?_=1436330129174 http/1.1 referer: http://myhost.cloudapp.net:9200/_plugin/marvel/sense/index.html accept: text/plain, */*; q=0.01 accept-language: en-us accept-encoding: gzip, deflate user-agent: mozilla/5.0 (windows nt 6.3; wow64; trident/7.0; rv:11.0) gecko host: xirtes.cloudapp.net:9200 proxy-connection: keep-alive any appreciated.
try:
output { elasticsearch { index => "%{index}_%{+yyyy.mm.dd}" host => "myhost.cloudapp.net" port => "9200" protocol => http idle_flush_time => 1 flush_size => 5000 } }
Comments
Post a Comment