Trying to configure Logstash to use a proxy with LS_JAVA_OPTS but it doesn't seem to work -


elastic running on windows server 2012 r2 vm in azure. vm1: running in hyper-v on workstation windows server 2012 r2. no proxy vm2: setup in protected domain windows server 2012 r2; requires proxy

my logstash config (my.config) has output definition:

elasticsearch  {      host => "myhost.cloudapp.net"     cluster => "mycluster"     document_type => "%{type}"     index => "%{index}_%{+yyyy.mm.dd}"     template_name => "%{index}"     document_id => "%{id}"     protocol => "http" } 

vm1 can load data elastic search host fine zipped logstash folder vm1 , copied vm2 , extracted it. created start.bat file placed in \logstash\bin

cls set java_home=d:\jdk set ls_java_opts=-dhttp.proxyhost=myproxy.mydomain.com -dhttp.proxyport=8080 logstash.bat agent -f my.conf 

when running on vm2, following produced in command prompt window:

io/console not supported; tty not manipulated failed install template: connect timed out {:level=>:error} logstash startup completed got error send bulk of actions: connect timed out {:level=>:error} failed flush outgoing items {:outgoing_count=>1, :exception=>#<manticore::timeout: connect timed out>,  :backtrace=>["d:/logstash/vendor/bundle/jruby/1.9/gems/manticore-0.4.1-java/lib/manticore/response.rb:35:in `initialize'",  "org/jruby/rubyproc.java:271:in `call'",  "d:/logstash/vendor/bundle/jruby/1.9/gems/manticore-0.4.1-java/lib/manticore/response.rb:61:in `call'",  "d:/logstash/vendor/bundle/jruby/1.9/gems/manticore-0.4.1-java/lib/manticore/response.rb:225:in `call_once'",  "d:/logstash/vendor/bundle/jruby/1.9/gems/manticore-0.4.1-java/lib/manticore/response.rb:128:in `code'",  "d:/logstash/vendor/bundle/jruby/1.9/gems/elasticsearch-transport-1.0.12/lib/elasticsearch/transport/transport/http/manticore.rb:71:in `perform_request'",  "org/jruby/rubyproc.java:271:in `call'",  "d:/logstash/vendor/bundle/jruby/1.9/gems/elasticsearch-transport-1.0.12/lib/elasticsearch/transport/transport/base.rb:190:in `perform_request'",  "d:/logstash/vendor/bundle/jruby/1.9/gems/elasticsearch-transport-1.0.12/lib/elasticsearch/transport/transport/http/manticore.rb:54:in `perform_request'",  "d:/logstash/vendor/bundle/jruby/1.9/gems/elasticsearch-transport-1.0.12/lib/elasticsearch/transport/client.rb:119:in `perform_request'",  "d:/logstash/vendor/bundle/jruby/1.9/gems/elasticsearch-api-1.0.12/lib/elasticsearch/api/actions/bulk.rb:80:in `bulk'",  "d:/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-1.0.1-java/lib/logstash/outputs/elasticsearch/protocol.rb:103:in `bulk'",  "d:/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-1.0.1-java/lib/logstash/outputs/elasticsearch.rb:505:in `submit'",  "d:/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-1.0.1-java/lib/logstash/outputs/elasticsearch.rb:529:in `flush'",  "d:/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.20/lib/stud/buffer.rb:219:in `buffer_flush'",  "org/jruby/rubyhash.java:1341:in `each'",  "d:/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.20/lib/stud/buffer.rb:216:in `buffer_flush'",  "d:/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.20/lib/stud/buffer.rb:112:in `buffer_initialize'",  "org/jruby/rubykernel.java:1511:in `loop'",  "d:/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.20/lib/stud/buffer.rb:110:in `buffer_initialize'"], :level=>:warn} 

i tried logstash v1.5.0. updated logstash version in vm2 v1.5.2, not seem help.

i went "configure java" gui , setup proxy under network settings , didn't help. i'm using jdk version 1.8.0_45-b15.

i tried using http output plugin, did not work. here's logstash config that:

 http  {       http_method => "post"       url => "http://myhost.cloudapp.net/myindex/mytype"  } 

the error getting (only copied exception message below).

:response=>nil, :exception=>#<errno::ebadf: bad file descriptor - bad file descriptor> 

it worth mentioning can use mozilla , internet explorer marvel sense plugin , can issue requests elastic search cluster. here's example request header fiddler:

get http://myhost.cloudapp.net:9200/_cat/indices?_=1436330129174 http/1.1 referer: http://myhost.cloudapp.net:9200/_plugin/marvel/sense/index.html accept: text/plain, */*; q=0.01 accept-language: en-us accept-encoding: gzip, deflate user-agent: mozilla/5.0 (windows nt 6.3; wow64; trident/7.0; rv:11.0) gecko host: xirtes.cloudapp.net:9200 proxy-connection: keep-alive 

any appreciated.

try:
output { elasticsearch { index => "%{index}_%{+yyyy.mm.dd}" host => "myhost.cloudapp.net" port => "9200" protocol => http idle_flush_time => 1 flush_size => 5000 } }


Comments

Popular posts from this blog

toolbar - How to add link to user registration inside toobar in admin joomla 3 custom component -

linux - disk space limitation when creating war file -

How to provide Authorization & Authentication using Asp.net, C#? -