ITeye博客

术业有专攻

ylzhj02 · 共 294 篇文章

Ngnix log to Elasticsearch

nginx-es.conf input { file { path => "/opt/logtest/nginx_access.log.1" start_position => "beginning" sincedb_path => "/opt/logstash-2.3.4/sincedb/" } } filter { ruby{ init => "@kname=['remote_addr','time_local','http_host','request','status','body_bytes_sent','http_referer','http_user_agent','upstr…

2016-08-03 17:39 · Logstash · 评论(0)

Install Logstash And Sample Conf

1. Download #wget https://download.elastic.co/logstash/logstash/logstash-2.3.4.tar.gz #tar -xzf logstash-2.3.4.tar.gz #cd logstash-2.3.4 #./bin/logstash-plugin install logstash-output-webhdfs Error Installing logstash-output-webhdfs Error Bundler::InstallError, retrying 1/10 An error occurred while…

2016-08-01 11:05 · Logstash · 评论(0)

大数据挖掘高质量博客

https://pkghosh.wordpress.com/2012/09/03/from-item-correlation-to-rating-prediction/ https://pkghosh.wordpress.com/?s=recommendation sifarish https://github.com/pranab/sifarish

2016-07-29 14:20 · 系统架构 · 评论(0)

Storm: monitor storm with supervisor

#yum install supervisor #vi /etc/supervisord.conf [program:storm-supervisor] command=/opt/apache-storm-0.9.3/bin/storm supervisor user=root autostart=true autorestart=true startsecs=10 startretries=999 log_stdout=true log_stderr=true logfile=/var/log/storm/supervisor.out logfile_maxbytes=20MB logfi…

2015-09-02 15:58 · Solr · 评论(0)

Solr: 5.2.1 install and config

1. upload solr-5.2.1.tgz install_solr_service.sh to the same dir 2.# install_solr_service.sh solr-5.2.1.tgz 3. #cd /var/solr/ #vi solr.in.sh modify solr's jvm configure #SOLR_HEAP="1024M" SOLR_JAVA_MEM="-Xms512m -Xmx2048m" 4. upload related depencies jars like constom tokenizer jars cp tokenizer ja…

2015-09-01 18:50 · Solr · 评论(0)

Solr: index product and price for sellers and perfoming query and sorting

In my current project, the modle seller has multiply products with price, I want to index products and query them then sorting them by price , seller's credit ,the distance between the seller and the user while highlighting the matched products. Due to solr flatten one-to-many relationship, so I sh…

2015-08-25 16:58 · Solr · 评论(0)

Top ML software

http://www.predictiveanalyticstoday.com/top-free-software-for-text-analysis-text-mining-text-analytics/

2015-08-05 15:02 · Theory · 评论(0)

Curator: delay queue

curator http://curator.apache.org/curator-client/index.html

2015-08-03 16:15 · Curator · 评论(0)

mac short-cut keys

http://my.oschina.net/leejan97/blog/214112?p=1

2015-07-15 10:38 · operatingsystem · 评论(0)

matlab install on ubuntu

http://blog.csdn.net/lanbing510/article/details/41698285

2015-07-10 13:59 · 评论(0)

Solr: Using FunctionQuery in SOLR Sort Syntax

In my project, I got a similar problem likes http://stackoverflow.com/questions/27701533/using-functionquery-in-solr-sort-syntax I want to sort my documents by a custom score using function sort=div(product(field(score),credit),distance) asc Error: "error": { "msg": "sort param could not be parsed …

2015-07-07 17:36 · Solr · 评论(0)

Ubuntu: common errors

when run #sudo update-manager error: solution: sudo apt-get update && sudo apt-get dist-upgrade --------- update firefox flash plugin #tar -xzf install_flash_player_11_linux.x86_64.tar.gz #sudo cp libflashplayer.so /usr/lib/mozilla/plugins/ #sudo cp -r usr/* /usr

2015-07-07 09:53 · operatingsystem · 评论(0)

Solr: integrate carrot2 with solr-5.1.0

I already integrated carrot2 with solr-4.x with my customerized chinese tokenizer successfully. But I run some errors following my series of blogs http://ylzhj02.iteye.com/blog/2152348 to adopt carrot2 to solr-5.1.0 The error is org.carrot2.util.factory.FallbackFactory; Tokenizer for Chinese Simpli…

2015-07-01 10:42 · Solr · 评论(0)

Solr: Spatial Search

1. schema <fieldType name="location_rpt" class="solr.SpatialRecursivePrefixTreeFieldType" geo="true" distErrPct="0.025" maxDistErr="0.001" distanceUnits="kilometers"/> <field name="location_rpt" type="location_rpt" indexed="true" stored="true" multiValued="true"/> data import select id, name, latit…

2015-06-26 14:59 · Solr · 评论(0)

Solr: Synonym Query

1. config schema.xml <fieldtype name="text_ch" class="solr.TextField"> <analyzer type="index"> <tokenizer class="org.lionsoul.jcseg.analyzer.JcsegTokenizerFactory" mode="complex"/> </analyzer> <analyzer type="query"> <tokenizer class="org.lionsoul.jcseg.analyzer.JcsegTokenizerFactory" mode="complex…

2015-06-18 17:59 · Solr · 评论(0)