Linux python3原生虚拟环境部署Hanlp

Linux Anaconda 环境 hanlp JVM 及libstdc++.so.6部署小技巧

Linux Anaconda 环境 hanlp JVM 部署及libstdc++.so.6部署小技巧

Linux Anaconda 环境 Python 及Sudo Python 导包小技巧

Linux Python 及Sudo Python 导包小技巧

Linux+Docker 环境 +Tensorlfow 部署探索

Linux+Docker+Tensorlfow 部署探索

Linux Anaconda环境 部署Tensorflow

Linux 环境部署|Anaconda及Tensorflow

Linux virtualenv环境 python及HanLP部署

Linux系统 virtualenv python虚拟环境及HanLP部署

Linux python3 原生虚拟环境部署Hanlp

python3 新建虚拟环境

[centos@host33 local]$ python -m venv  svm_virtual_env
Error: [Errno 13] Permission denied: '/usr/local/svm_virtual_env'[centos@host33 local]$ sudo python -m venv  svm_virtual_env
/bin/python: No module named venv[centos@host33 local]$ sudo python3 -m venv  svm_virtual_env
[centos@host33 local]$ 

进入python3 虚拟环境

[centos@host33 bin]$ pwd
/usr/local/svm_virtual_env/bin
[centos@host33 bin]$ source /usr/local/svm_virtual_env/bin/activate
(svm_virtual_env) [centos@host33 bin]$ ls
activate      activate.fish  easy_install-3.6  pip3    python
activate.csh  easy_install   pip               pip3.6  python3

安装hanlp

提示报错， #include <Python.h> // FIXME work on bytes, remove when complete

(svm_virtual_env) [centos@host33 setup_tools]$  pip3 install pyhanlp -i https://pypi.tuna.tsinghua.edu.cn/simple    
Collecting pyhanlpDownloading https://pypi.tuna.tsinghua.edu.cn/packages/8f/99/13078d71bc9f77705a29f932359046abac3001335ea1d21e91120b200b21/pyhanlp-0.1.66.tar.gz (86kB)......
Installing collected packages: jpype1, pyhanlpRunning setup.py install for jpype1 ... errorComplete output from command /usr/local/svm_virtual_env/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-xtj5rb5p/jpype1/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-2cobouzv-record/install-record.txt --single-version-externally-managed --compile --install-headers /usr/local/svm_virtual_env/include/site/python3.6/jpype1:Found native jni.h at /usr/local/jdk1.8.0/include/usr/lib64/python3.6/distutils/dist.py:261: UserWarning: Unknown distribution option: 'use_scm_version'warnings.warn(msg)running installrunning buildrunning build_pycreating buildcreating build/lib.linux-x86_64-3.6creating build/lib.linux-x86_64-3.6/jpypecopying jpype/__init__.py -> build/lib.linux-x86_64-3.6/jpype
......copying jpype/_jvmfinder.py -> build/lib.linux-x86_64-3.6/jpypecopying jpype/_linux.py -> build/lib.linux-x86_64-3.6/jpypecopying jpype/_pykeywords.py -> build/lib.linux-x86_64-3.6/jpypecopying jpype/_windows.py -> build/lib.linux-x86_64-3.6/jpype......creating build/temp.linux-x86_64-3.6/nativecreating build/temp.linux-x86_64-3.6/native/commoncreating build/temp.linux-x86_64-3.6/native/pythongcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -Inative/common/include -Inative/python/include -Ibuild/src -I/usr/local/jdk1.8.0/include -I/usr/local/jdk1.8.0/include/linux -I/usr/local/svm_virtual_env/include -I/usr/include/python3.6m -c build/src/jp_thunk.cpp -o build/temp.linux-x86_64-3.6/build/src/jp_thunk.o -g3 -std=c++11 -ggdbgcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -Inative/common/include -Inative/python/include -Ibuild/src -I/usr/local/jdk1.8.0/include -I/usr/local/jdk1.8.0/include/linux -I/usr/local/svm_virtual_env/include -I/usr/include/python3.6m -c native/common/jp_array.cpp -o build/temp.linux-x86_64-3.6/native/common/jp_array.o -g3 -std=c++11 -ggdbgcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -Inative/common/include -Inative/python/include -Ibuild/src -I/usr/local/jdk1.8.0/include -I/usr/local/jdk1.8.0/include/linux -I/usr/local/svm_virtual_env/include -I/usr/include/python3.6m -c native/common/jp_arrayclass.cpp -o build/temp.linux-x86_64-3.6/native/common/jp_arrayclass.o -g3 -std=c++11 -ggdbnative/common/jp_arrayclass.cpp:17:65: fatal error: Python.h: No such file or directory#include <Python.h> // FIXME work on bytes, remove when complete^compilation terminated.error: command 'gcc' failed with exit status 1----------------------------------------
Command "/usr/local/svm_virtual_env/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-xtj5rb5p/jpype1/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-2cobouzv-record/install-record.txt --single-version-externally-managed --compile --install-headers /usr/local/svm_virtual_env/include/site/python3.6/jpype1" failed with error code 1 in /tmp/pip-build-xtj5rb5p/jpype1/
You have new mail in /var/spool/mail/centos

安装python36-devel开发包

(svm_virtual_env) [centos@host33 setup_tools]$ sudo yum install python36-devel
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile* base: mirrors.aliyun.com* epel: mirrors.yun-idc.com* extras: mirrors.aliyun.com* remi-php74: mirror.innosol.asia
.......python3-rpm-macros     noarch 3-32.el7              base 7.7 kredhat-rpm-config      noarch 9.1.0-88.el7.centos   base  81 kzip                    x86_64 3.0-11.el7            base 260 kTransaction Summary
================================================================
Install  1 Package (+6 Dependent packages)Total download size: 687 k
Installed size: 1.8 M
Is this ok [y/d/N]: y
Downloading packages:
(1/7): perl-srpm-macros-1-8.el7.noarch.rpm | 4.6 kB   00:00     
(2/7): dwz-0.11-3.el7.x86_64.rpm           |  99 kB   00:00     
(3/7): python3-rpm-generators-6-2.el7.noar |  20 kB   00:00     
(4/7): python3-rpm-macros-3-32.el7.noarch. | 7.7 kB   00:00     
(5/7): redhat-rpm-config-9.1.0-88.el7.cent |  81 kB   00:00     
(6/7): python3-devel-3.6.8-13.el7.x86_64.r | 215 kB   00:00     
(.......            python3-rpm-generators.noarch 0:6-2.el7                       python3-rpm-macros.noarch 0:3-32.el7                          redhat-rpm-config.noarch 0:9.1.0-88.el7.centos                zip.x86_64 0:3.0-11.el7                                       Complete!
You have new mail in /var/spool/mail/centos

修改虚拟环境目录的权限

(svm_virtual_env) [centos@host33 setup_tools]$ sudo chmod -R 777 /usr/local/svm_virtual_env/
(svm_virtual_env) [centos@host33 setup_tools]$ pwd
/usr/local/setup_tools
(svm_virtual_env) [centos@host33 setup_tools]$ ls -ltr -h  /usr/local/svm_virtual_env/
total 8.0K
drwxrwxrwx 2 root root    6 Jun 23 06:19 include
-rwxrwxrwx 1 root root   65 Jun 23 06:19 pyvenv.cfg
lrwxrwxrwx 1 root root    3 Jun 23 06:19 lib64 -> lib
drwxrwxrwx 3 root root   22 Jun 23 06:19 lib
drwxrwxrwx 2 root root 4.0K Jun 23 06:19 bin

安装hanlp

(svm_virtual_env) [centos@host33 setup_tools]$   pip3 install pyhanlp -i https://pypi.tuna.tsinghua.edu.cn/simple
Collecting pyhanlpDownloading https://pypi.tuna.tsinghua.edu.cn/packages/8f/99/13078d71bc9f77705a29f932359046abac3001335ea1d21e91120b200b21/pyhanlp- 
Collecting jpype1==0.7.0 (from pyhanlp)Downloading https://pypi.tuna.tsinghua.edu.cn/packages/28/63/784834e8a24ec2e1ad7f703c3dc6c6fb372a77cc68a2fdff916e18a4449e/JPype1-0.7.0.tar.gz (470kB)2% |▊                               | 10kB 29.9MB/s eta 0:00    4% |█▍                              | 20kB 3.7MB/s eta 0:00:    6% |██                              | 30kB 5.2MB/s eta 0:00:    8% |██▉                             | 。。。。B/s 
Installing collected packages: jpype1, pyhanlpRunning setup.py install for jpype1 ... doneRunning setup.py install for pyhanlp ... done
Successfully installed jpype1-0.7.0 pyhanlp-0.1.66
You are using pip version 9.0.3, however version 20.1.1 is available.ou should consider upgrading via the 'pip install --upgrade pip' command.
You have new mail in /var/spool/mail/centos
(svm_virtual_env) [centos@host33 setup_tools]$ pip3 list
DEPRECATION: The default format will switch to columns in the future. You can use --format=(legacy|columns) (or define a format=(legacy|columns) in your pip.conf under the [list] section) to disable this warning.
JPype1 (0.7.0)
pip (9.0.3)
pyhanlp (0.1.66)
setuptools (39.2.0)
You are using pip version 9.0.3, however version 20.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.

使用sudo pip安装，将安装到系统环境里面（python2.7）

上传data数据字典，查询hanlp版本

(svm_virtual_env) [centos@host33 static]$ cp -r /home/centos/static/data /usr/local/svm_virtual_env/lib/python3.6/site-packages/pyhanlp/static/
You have new mail in /var/spool/mail/centos#IOAdapter=com.hankcs.hanlp.corpus.io.FileIOAdapter(svm_virtual_env) [centos@host33 static]$ hanlp --version
jar  1.7.8: /usr/local/svm_virtual_env/lib/python3.6/site-packages/pyhanlp/static/hanlp-1.7.8.jar
data 1.7.6: /usr/local/svm_virtual_env/lib/python3.6/site-packages/pyhanlp/static/data
config    : /usr/local/svm_virtual_env/lib/python3.6/site-packages/pyhanlp/static/hanlp.properties
(svm_virtual_env) [centos@host33 static]$ hanlp segment
商品和服务
商品/n 和/cc 服务/vn

安装fuzzywuzzy、sklearn包

fuzzywuzzy
jieba
pandas
sklearn
joblib
requests