术业有专攻
ylzhj02 · 共 294 篇文章
Ngnix log to Elasticsearch
nginx-es.conf input { file { path => "/opt/logtest/nginx_access.log.1" start_position => "beginning" sincedb_path => "/opt/logstash-2.3.4/sincedb/" } } filter { ruby{ init => "@kname=['remote_addr','time_local','http_host','request','status','body_bytes_sent','http_referer','http_user_agent','upstr…
2016-08-03 17:39 · Logstash · 评论(0)
Install Logstash And Sample Conf
1. Download #wget https://download.elastic.co/logstash/logstash/logstash-2.3.4.tar.gz #tar -xzf logstash-2.3.4.tar.gz #cd logstash-2.3.4 #./bin/logstash-plugin install logstash-output-webhdfs Error Installing logstash-output-webhdfs Error Bundler::InstallError, retrying 1/10 An error occurred while…
2016-08-01 11:05 · Logstash · 评论(0)
大数据挖掘高质量博客
https://pkghosh.wordpress.com/2012/09/03/from-item-correlation-to-rating-prediction/ https://pkghosh.wordpress.com/?s=recommendation sifarish https://github.com/pranab/sifarish
2016-07-29 14:20 · 系统架构 · 评论(0)
Storm: monitor storm with supervisor
#yum install supervisor #vi /etc/supervisord.conf [program:storm-supervisor] command=/opt/apache-storm-0.9.3/bin/storm supervisor user=root autostart=true autorestart=true startsecs=10 startretries=999 log_stdout=true log_stderr=true logfile=/var/log/storm/supervisor.out logfile_maxbytes=20MB logfi…
2015-09-02 15:58 · Solr · 评论(0)
Solr: 5.2.1 install and config
1. upload solr-5.2.1.tgz install_solr_service.sh to the same dir 2.# install_solr_service.sh solr-5.2.1.tgz 3. #cd /var/solr/ #vi solr.in.sh modify solr's jvm configure #SOLR_HEAP="1024M" SOLR_JAVA_MEM="-Xms512m -Xmx2048m" 4. upload related depencies jars like constom tokenizer jars cp tokenizer ja…
2015-09-01 18:50 · Solr · 评论(0)
Solr: index product and price for sellers and perfoming query and sorting
In my current project, the modle seller has multiply products with price, I want to index products and query them then sorting them by price , seller's credit ,the distance between the seller and the user while highlighting the matched products. Due to solr flatten one-to-many relationship, so I sh…
2015-08-25 16:58 · Solr · 评论(0)
Top ML software
http://www.predictiveanalyticstoday.com/top-free-software-for-text-analysis-text-mining-text-analytics/
2015-08-05 15:02 · Theory · 评论(0)
Curator: delay queue
curator http://curator.apache.org/curator-client/index.html
2015-08-03 16:15 · Curator · 评论(0)
mac short-cut keys
http://my.oschina.net/leejan97/blog/214112?p=1
2015-07-15 10:38 · operatingsystem · 评论(0)
matlab install on ubuntu
http://blog.csdn.net/lanbing510/article/details/41698285
2015-07-10 13:59 · 评论(0)
Solr: Using FunctionQuery in SOLR Sort Syntax
In my project, I got a similar problem likes http://stackoverflow.com/questions/27701533/using-functionquery-in-solr-sort-syntax I want to sort my documents by a custom score using function sort=div(product(field(score),credit),distance) asc Error: "error": { "msg": "sort param could not be parsed …
2015-07-07 17:36 · Solr · 评论(0)
Ubuntu: common errors
when run #sudo update-manager error: solution: sudo apt-get update && sudo apt-get dist-upgrade --------- update firefox flash plugin #tar -xzf install_flash_player_11_linux.x86_64.tar.gz #sudo cp libflashplayer.so /usr/lib/mozilla/plugins/ #sudo cp -r usr/* /usr
2015-07-07 09:53 · operatingsystem · 评论(0)
Solr: integrate carrot2 with solr-5.1.0
I already integrated carrot2 with solr-4.x with my customerized chinese tokenizer successfully. But I run some errors following my series of blogs http://ylzhj02.iteye.com/blog/2152348 to adopt carrot2 to solr-5.1.0 The error is org.carrot2.util.factory.FallbackFactory; Tokenizer for Chinese Simpli…
2015-07-01 10:42 · Solr · 评论(0)
Solr: Spatial Search
1. schema <fieldType name="location_rpt" class="solr.SpatialRecursivePrefixTreeFieldType" geo="true" distErrPct="0.025" maxDistErr="0.001" distanceUnits="kilometers"/> <field name="location_rpt" type="location_rpt" indexed="true" stored="true" multiValued="true"/> data import select id, name, latit…
2015-06-26 14:59 · Solr · 评论(0)
Solr: Synonym Query
1. config schema.xml <fieldtype name="text_ch" class="solr.TextField"> <analyzer type="index"> <tokenizer class="org.lionsoul.jcseg.analyzer.JcsegTokenizerFactory" mode="complex"/> </analyzer> <analyzer type="query"> <tokenizer class="org.lionsoul.jcseg.analyzer.JcsegTokenizerFactory" mode="complex…
2015-06-18 17:59 · Solr · 评论(0)