/usr/bin/python2.7 /mnt/Data/Projects/ecomobi-microservice/topica_analytic.py
INFO:common.jdbc:Connecting to database
	->dbname='fb_detail' user='ecodata' host='104.199.222.244' port='5432' password='Eco12387654'
INFO:parameter:Load 907 ids of universities
INFO:parameter:Load 63 ids of provinces
INFO:parameter:Load 7 ids of school types
INFO:parameter:Load 19 ids of majors
/home/chiennd/.local/lib/python2.7/site-packages/sklearn/cross_validation.py:44: DeprecationWarning: This module was deprecated in version 0.18 in favor of the model_selection module into which all the refactored classes and functions are moved. Also note that the interface of the new CV iterators are different from that of this module. This module will be removed in 0.20.
  "This module will be removed in 0.20.", DeprecationWarning)
INFO:common.jdbc:Connecting to database
	->dbname='topica' user='ecomobi' host='localhost' port='2222' password='OD4o9ammD42'
INFO:__main__:Reading data....
sys:1: DtypeWarning: Columns (130,131,132,133) have mixed types. Specify dtype option on import or set low_memory=False.
INFO:__main__:Finish reading data, shape of data: (100361, 137)
INFO:__main__:Create extractor...
['Unnamed: 0' 'cds_id' 'label' 'mobile' 'id' 'age' 'birthday_year' 'gender'
 'birthday_month' 'birthday_day' 'education' 'work' 'oid' 'address' 'email'
 'first_name' 'hometown' 'locale' 'middle_name' 'last_name' 'phone'
 'relationship_status' 'birth_day' 'fb_id' 'id.1' 'schools'
 'highest_school_degree' 'majors' 'university' 'university_type'
 'university_location' 'id.2' 'hometown_province_id' 'location_province_id'
 'hometown.1' 'location' 'mobile.1' 'id.3' 'value' 'name' 'loc' 'id.4'
 'value.1' 'name.1' 'loc.1' 'cds_id.1' 'email_status'
 'is_email_related_name' 'is_beautiful_mobile_number' 'email.1' 'mobile.2'
 'name.2' 'age_email' 'age_mobile' 'company_email' 'email_name_status'
 'event_type' 'vid' 'statuscall' 'utm_id' 'nganhdk' 'trinhdo'
 'registereddate' 'nganhhoc' 'location_id' 'email.2' 'diemtuyensinh'
 'datelevel3a' 'datelevel3b' 'datelevel3c' 'calldate' 'schoolgrad' 'tvts'
 'callamount' 'totnghiep' 'datelevel1' 'datelevel2' 'datelevel4'
 'datelevel5' 'datelevel6' 'sid' 'datelevel8' 'majorname' 'age.1' 'c5'
 'landing_id' 'school' 'statuscare' 'level' 'mobile.3' 'gender.1' 'notes'
 'datelevel7' 'handoverdate' 'truongdk' 'fullname' 'device_id' 'isc5'
 'cds_id.2' 'appointmentdate' 'sourcetype' 'keyword' 'cid' 'number_contact'
 'created_at' 'c5_date' 'url_id' 'email2' 'id.5' 'sub_id' 'status'
 'crm_status' '_id' 'utm_campaign' 'code_chanel' 'utm_term' 'utm_content'
 'utm_source' 'utm_medium' 'utm_agent' 'utm_team' 'channel' 'cds_id.3'
 'mobile_number' 'mobile_networks' '_id.1' 'landingpage_version'
 'landing_page' 'mau_qc' 'san_pham' 'id_campaign' 'property_aid'
 'id_camp_landingpage' 'id_landingpage' 'kenh_con' 'property_code'
 'olm_onboarding']
['Unnamed: 0' 'cds_id' 'label' 'mobile' 'id' 'age' 'birthday_year' 'gender'
 'birthday_month' 'birthday_day' 'education' 'work' 'oid' 'address' 'email'
 'first_name' 'hometown' 'locale' 'middle_name' 'last_name' 'phone'
 'relationship_status' 'birth_day' 'fb_id' 'id.1' 'schools'
 'highest_school_degree' 'majors' 'university' 'university_type'
 'university_location' 'id.2' 'hometown_province_id' 'location_province_id'
 'hometown.1' 'location' 'mobile.1' 'id.3' 'value' 'name' 'loc' 'id.4'
 'value.1' 'name.1' 'loc.1' 'cds_id.1' 'email_status'
 'is_email_related_name' 'is_beautiful_mobile_number' 'email.1' 'mobile.2'
 'name.2' 'age_email' 'age_mobile' 'company_email' 'email_name_status'
 'event_type' 'vid' 'statuscall' 'utm_id' 'nganhdk' 'trinhdo'
 'registereddate' 'nganhhoc' 'location_id' 'email.2' 'diemtuyensinh'
 'datelevel3a' 'datelevel3b' 'datelevel3c' 'calldate' 'schoolgrad' 'tvts'
 'callamount' 'totnghiep' 'datelevel1' 'datelevel2' 'datelevel4'
 'datelevel5' 'datelevel6' 'sid' 'datelevel8' 'majorname' 'age.1' 'c5'
 'landing_id' 'school' 'statuscare' 'level' 'mobile.3' 'gender.1' 'notes'
 'datelevel7' 'handoverdate' 'truongdk' 'fullname' 'device_id' 'isc5'
 'cds_id.2' 'appointmentdate' 'sourcetype' 'keyword' 'cid' 'number_contact'
 'created_at' 'c5_date' 'url_id' 'email2' 'id.5' 'sub_id' 'status'
 'crm_status' '_id' 'utm_campaign' 'code_chanel' 'utm_term' 'utm_content'
 'utm_source' 'utm_medium' 'utm_agent' 'utm_team' 'channel' 'cds_id.3'
 'mobile_number' 'mobile_networks' '_id.1' 'landingpage_version'
 'landing_page' 'mau_qc' 'san_pham' 'id_campaign' 'property_aid'
 'id_camp_landingpage' 'id_landingpage' 'kenh_con' 'property_code'
 'olm_onboarding']
After clean: (97279, 31)
After clean: (3082, 31)
------------------------- Time 0 ---------------------------
Train (90324, 31)
Test (10037, 31)
Number of true-predicted items: 9720
Number of false-predicted items: 317
Label: [ 0.  1.]
True by label: [9673   47]
False by label: [ 55 262]
Accuracy - 0 - 1 - total: [ 0.99434622  0.15210356  0.96841686]
------------------------- Time 1 ---------------------------
Train (90324, 31)
Test (10037, 31)
Number of true-predicted items: 9726
Number of false-predicted items: 311
Label: [ 0.  1.]
True by label: [9683   43]
False by label: [ 45 266]
Accuracy - 0 - 1 - total: [ 0.99537418  0.13915858  0.96901465]
------------------------- Time 2 ---------------------------
Train (90325, 31)
Test (10036, 31)
Number of true-predicted items: 9725
Number of false-predicted items: 311
Label: [ 0.  1.]
True by label: [9668   57]
False by label: [ 60 251]
Accuracy - 0 - 1 - total: [ 0.99383224  0.18506494  0.96901156]
------------------------- Time 3 ---------------------------
Train (90325, 31)
Test (10036, 31)
Number of true-predicted items: 9731
Number of false-predicted items: 305
Label: [ 0.  1.]
True by label: [9680   51]
False by label: [ 48 257]
Accuracy - 0 - 1 - total: [ 0.99506579  0.16558442  0.96960941]
------------------------- Time 4 ---------------------------
Train (90325, 31)
Test (10036, 31)
Number of true-predicted items: 9751
Number of false-predicted items: 285
Label: [ 0.  1.]
True by label: [9689   62]
False by label: [ 39 246]
Accuracy - 0 - 1 - total: [ 0.99599095  0.2012987   0.97160223]
------------------------- Time 5 ---------------------------
Train (90325, 31)
Test (10036, 31)
Number of true-predicted items: 9725
Number of false-predicted items: 311
Label: [ 0.  1.]
True by label: [9678   47]
False by label: [ 50 261]
Accuracy - 0 - 1 - total: [ 0.9948602   0.1525974   0.96901156]
------------------------- Time 6 ---------------------------
Train (90325, 31)
Test (10036, 31)
Number of true-predicted items: 9736
Number of false-predicted items: 300
Label: [ 0.  1.]
True by label: [9685   51]
False by label: [ 43 257]
Accuracy - 0 - 1 - total: [ 0.99557977  0.16558442  0.97010761]
------------------------- Time 7 ---------------------------
Train (90325, 31)
Test (10036, 31)
Number of true-predicted items: 9719
Number of false-predicted items: 317
Label: [ 0.  1.]
True by label: [9680   39]
False by label: [ 48 269]
Accuracy - 0 - 1 - total: [ 0.99506579  0.12662338  0.96841371]
------------------------- Time 8 ---------------------------
Train (90325, 31)
Test (10036, 31)
Number of true-predicted items: 9723
Number of false-predicted items: 313
Label: [ 0.  1.]
True by label: [9669   54]
False by label: [ 59 254]
Accuracy - 0 - 1 - total: [ 0.99393503  0.17532468  0.96881228]
------------------------- Time 9 ---------------------------
Train (90326, 31)
Test (10035, 31)
Number of true-predicted items: 9724
Number of false-predicted items: 311
Label: [ 0.  1.]
True by label: [9682   42]
False by label: [ 45 266]
Accuracy - 0 - 1 - total: [ 0.9953737   0.13636364  0.96900847]
[array([ 0.99434622,  0.15210356,  0.96841686]), array([ 0.99537418,  0.13915858,  0.96901465]), array([ 0.99383224,  0.18506494,  0.96901156]), array([ 0.99506579,  0.16558442,  0.96960941]), array([ 0.99599095,  0.2012987 ,  0.97160223]), array([ 0.9948602 ,  0.1525974 ,  0.96901156]), array([ 0.99557977,  0.16558442,  0.97010761]), array([ 0.99506579,  0.12662338,  0.96841371]), array([ 0.99393503,  0.17532468,  0.96881228]), array([ 0.9953737 ,  0.13636364,  0.96900847])]
Final [ 0.99494239  0.15997037  0.96930083]

Process finished with exit code 0