/usr/bin/python2.7 /mnt/Data/Projects/ecomobi-microservice/topica_analytic.py
INFO:common.jdbc:Connecting to database
	->dbname='fb_detail' user='ecodata' host='104.199.222.244' port='5432' password='Eco12387654'
INFO:parameter:Load 907 ids of universities
INFO:parameter:Load 63 ids of provinces
INFO:parameter:Load 7 ids of school types
INFO:parameter:Load 19 ids of majors
/home/chiennd/.local/lib/python2.7/site-packages/sklearn/cross_validation.py:44: DeprecationWarning: This module was deprecated in version 0.18 in favor of the model_selection module into which all the refactored classes and functions are moved. Also note that the interface of the new CV iterators are different from that of this module. This module will be removed in 0.20.
  "This module will be removed in 0.20.", DeprecationWarning)
INFO:common.jdbc:Connecting to database
	->dbname='topica' user='ecomobi' host='localhost' port='2222' password='OD4o9ammD42'
INFO:__main__:Reading data....
sys:1: DtypeWarning: Columns (130,131,132,133) have mixed types. Specify dtype option on import or set low_memory=False.
INFO:__main__:Finish reading data, shape of data: (100361, 137)
INFO:__main__:Create extractor...
['Unnamed: 0' 'cds_id' 'label' 'mobile' 'id' 'age' 'birthday_year' 'gender'
 'birthday_month' 'birthday_day' 'education' 'work' 'oid' 'address' 'email'
 'first_name' 'hometown' 'locale' 'middle_name' 'last_name' 'phone'
 'relationship_status' 'birth_day' 'fb_id' 'id.1' 'schools'
 'highest_school_degree' 'majors' 'university' 'university_type'
 'university_location' 'id.2' 'hometown_province_id' 'location_province_id'
 'hometown.1' 'location' 'mobile.1' 'id.3' 'value' 'name' 'loc' 'id.4'
 'value.1' 'name.1' 'loc.1' 'cds_id.1' 'email_status'
 'is_email_related_name' 'is_beautiful_mobile_number' 'email.1' 'mobile.2'
 'name.2' 'age_email' 'age_mobile' 'company_email' 'email_name_status'
 'event_type' 'vid' 'statuscall' 'utm_id' 'nganhdk' 'trinhdo'
 'registereddate' 'nganhhoc' 'location_id' 'email.2' 'diemtuyensinh'
 'datelevel3a' 'datelevel3b' 'datelevel3c' 'calldate' 'schoolgrad' 'tvts'
 'callamount' 'totnghiep' 'datelevel1' 'datelevel2' 'datelevel4'
 'datelevel5' 'datelevel6' 'sid' 'datelevel8' 'majorname' 'age.1' 'c5'
 'landing_id' 'school' 'statuscare' 'level' 'mobile.3' 'gender.1' 'notes'
 'datelevel7' 'handoverdate' 'truongdk' 'fullname' 'device_id' 'isc5'
 'cds_id.2' 'appointmentdate' 'sourcetype' 'keyword' 'cid' 'number_contact'
 'created_at' 'c5_date' 'url_id' 'email2' 'id.5' 'sub_id' 'status'
 'crm_status' '_id' 'utm_campaign' 'code_chanel' 'utm_term' 'utm_content'
 'utm_source' 'utm_medium' 'utm_agent' 'utm_team' 'channel' 'cds_id.3'
 'mobile_number' 'mobile_networks' '_id.1' 'landingpage_version'
 'landing_page' 'mau_qc' 'san_pham' 'id_campaign' 'property_aid'
 'id_camp_landingpage' 'id_landingpage' 'kenh_con' 'property_code'
 'olm_onboarding']
['Unnamed: 0' 'cds_id' 'label' 'mobile' 'id' 'age' 'birthday_year' 'gender'
 'birthday_month' 'birthday_day' 'education' 'work' 'oid' 'address' 'email'
 'first_name' 'hometown' 'locale' 'middle_name' 'last_name' 'phone'
 'relationship_status' 'birth_day' 'fb_id' 'id.1' 'schools'
 'highest_school_degree' 'majors' 'university' 'university_type'
 'university_location' 'id.2' 'hometown_province_id' 'location_province_id'
 'hometown.1' 'location' 'mobile.1' 'id.3' 'value' 'name' 'loc' 'id.4'
 'value.1' 'name.1' 'loc.1' 'cds_id.1' 'email_status'
 'is_email_related_name' 'is_beautiful_mobile_number' 'email.1' 'mobile.2'
 'name.2' 'age_email' 'age_mobile' 'company_email' 'email_name_status'
 'event_type' 'vid' 'statuscall' 'utm_id' 'nganhdk' 'trinhdo'
 'registereddate' 'nganhhoc' 'location_id' 'email.2' 'diemtuyensinh'
 'datelevel3a' 'datelevel3b' 'datelevel3c' 'calldate' 'schoolgrad' 'tvts'
 'callamount' 'totnghiep' 'datelevel1' 'datelevel2' 'datelevel4'
 'datelevel5' 'datelevel6' 'sid' 'datelevel8' 'majorname' 'age.1' 'c5'
 'landing_id' 'school' 'statuscare' 'level' 'mobile.3' 'gender.1' 'notes'
 'datelevel7' 'handoverdate' 'truongdk' 'fullname' 'device_id' 'isc5'
 'cds_id.2' 'appointmentdate' 'sourcetype' 'keyword' 'cid' 'number_contact'
 'created_at' 'c5_date' 'url_id' 'email2' 'id.5' 'sub_id' 'status'
 'crm_status' '_id' 'utm_campaign' 'code_chanel' 'utm_term' 'utm_content'
 'utm_source' 'utm_medium' 'utm_agent' 'utm_team' 'channel' 'cds_id.3'
 'mobile_number' 'mobile_networks' '_id.1' 'landingpage_version'
 'landing_page' 'mau_qc' 'san_pham' 'id_campaign' 'property_aid'
 'id_camp_landingpage' 'id_landingpage' 'kenh_con' 'property_code'
 'olm_onboarding']
After clean: (97279, 33)
After clean: (3082, 33)
------------------------- Time 0 ---------------------------
Train (90324, 33)
Test (10037, 33)
Number of true-predicted items: 9741
Number of false-predicted items: 296
Label: [ 0.  1.]
True by label: [9684   57]
False by label: [ 44 252]
Accuracy - 0 - 1 - total: [ 0.99547697  0.18446602  0.97050912]
------------------------- Time 1 ---------------------------
Train (90324, 33)
Test (10037, 33)
Number of true-predicted items: 9745
Number of false-predicted items: 292
Label: [ 0.  1.]
True by label: [9690   55]
False by label: [ 38 254]
Accuracy - 0 - 1 - total: [ 0.99609375  0.17799353  0.97090764]
------------------------- Time 2 ---------------------------
Train (90325, 33)
Test (10036, 33)
Number of true-predicted items: 9757
Number of false-predicted items: 279
Label: [ 0.  1.]
True by label: [9700   57]
False by label: [ 28 251]
Accuracy - 0 - 1 - total: [ 0.99712171  0.18506494  0.97220008]
------------------------- Time 3 ---------------------------
Train (90325, 33)
Test (10036, 33)
Number of true-predicted items: 9749
Number of false-predicted items: 287
Label: [ 0.  1.]
True by label: [9689   60]
False by label: [ 39 248]
Accuracy - 0 - 1 - total: [ 0.99599095  0.19480519  0.97140295]
------------------------- Time 4 ---------------------------
Train (90325, 33)
Test (10036, 33)
Number of true-predicted items: 9740
Number of false-predicted items: 296
Label: [ 0.  1.]
True by label: [9694   46]
False by label: [ 34 262]
Accuracy - 0 - 1 - total: [ 0.99650493  0.14935065  0.97050618]
------------------------- Time 5 ---------------------------
Train (90325, 33)
Test (10036, 33)
Number of true-predicted items: 9754
Number of false-predicted items: 282
Label: [ 0.  1.]
True by label: [9700   54]
False by label: [ 28 254]
Accuracy - 0 - 1 - total: [ 0.99712171  0.17532468  0.97190116]
------------------------- Time 6 ---------------------------
Train (90325, 33)
Test (10036, 33)
Number of true-predicted items: 9752
Number of false-predicted items: 284
Label: [ 0.  1.]
True by label: [9704   48]
False by label: [ 24 260]
Accuracy - 0 - 1 - total: [ 0.99753289  0.15584416  0.97170187]
------------------------- Time 7 ---------------------------
Train (90325, 33)
Test (10036, 33)
Number of true-predicted items: 9763
Number of false-predicted items: 273
Label: [ 0.  1.]
True by label: [9701   62]
False by label: [ 27 246]
Accuracy - 0 - 1 - total: [ 0.99722451  0.2012987   0.97279793]
------------------------- Time 8 ---------------------------
Train (90325, 33)
Test (10036, 33)
Number of true-predicted items: 9741
Number of false-predicted items: 295
Label: [ 0.  1.]
True by label: [9692   49]
False by label: [ 36 259]
Accuracy - 0 - 1 - total: [ 0.99629934  0.15909091  0.97060582]
------------------------- Time 9 ---------------------------
Train (90326, 33)
Test (10035, 33)
Number of true-predicted items: 9759
Number of false-predicted items: 276
Label: [ 0.  1.]
True by label: [9693   66]
False by label: [ 34 242]
Accuracy - 0 - 1 - total: [ 0.99650457  0.21428571  0.97249626]
[array([ 0.99547697,  0.18446602,  0.97050912]), array([ 0.99609375,  0.17799353,  0.97090764]), array([ 0.99712171,  0.18506494,  0.97220008]), array([ 0.99599095,  0.19480519,  0.97140295]), array([ 0.99650493,  0.14935065,  0.97050618]), array([ 0.99712171,  0.17532468,  0.97190116]), array([ 0.99753289,  0.15584416,  0.97170187]), array([ 0.99722451,  0.2012987 ,  0.97279793]), array([ 0.99629934,  0.15909091,  0.97060582]), array([ 0.99650457,  0.21428571,  0.97249626])]
Final [ 0.99658714  0.17975245  0.9715029 ]

Process finished with exit code 0