Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- +-----+-----+------------+------------+------------+------------+-------+------+------+------+-------+--------+
- | _c0| _c1| _c2| _c3| _c4| _c5| _c6| _c7| _c8| _c9| _c10| _c11|
- +-----+-----+------------+------------+------------+------------+-------+------+------+------+-------+--------+
- | id_1| id_2|cmp_fname_c1|cmp_fname_c2|cmp_lname_c1|cmp_lname_c2|cmp_sex|cmp_bd|cmp_bm|cmp_by|cmp_plz|is_match|
- | 607|53170| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- |88569|88592| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- |21282|26255| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- |20995|42541| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- |27989|34739| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- |32442|69159| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- |24738|29196| 1| 1| 1| ?| 1| 1| 1| 1| 1| TRUE|
- | 9904|89061| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- |29926|36578| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- |27815|46246| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- |71026|73461| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- |18812|54292| 1| 1| 1| ?| 1| 1| 1| 1| 0| TRUE|
- |20649|52511| 1| ?| 0.875| ?| 1| 1| 1| 1| 1| TRUE|
- |39573|49314| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- | 4018| 5824| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- |16333|40015| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- | 4572| 4636| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- |16892|39791| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- |40334|74815| 1| ?| 1| ?| 1| 1| 1| 1| 1| TRUE|
- +-----+-----+------------+------------+------------+------------+-------+------+------+------+-------+--------+
- only showing top 20 rows
- root
- |-- _c0: string (nullable = true)
- |-- _c1: string (nullable = true)
- |-- _c2: string (nullable = true)
- |-- _c3: string (nullable = true)
- |-- _c4: string (nullable = true)
- |-- _c5: string (nullable = true)
- |-- _c6: string (nullable = true)
- |-- _c7: string (nullable = true)
- |-- _c8: string (nullable = true)
- |-- _c9: string (nullable = true)
- |-- _c10: string (nullable = true)
- |-- _c11: string (nullable = true)
- +-----+-----+------------+------------+------------+------------+-------+------+------+------+-------+--------+
- | id_1| id_2|cmp_fname_c1|cmp_fname_c2|cmp_lname_c1|cmp_lname_c2|cmp_sex|cmp_bd|cmp_bm|cmp_by|cmp_plz|is_match|
- +-----+-----+------------+------------+------------+------------+-------+------+------+------+-------+--------+
- | 607|53170| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- |88569|88592| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- |21282|26255| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- |20995|42541| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- |27989|34739| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- |32442|69159| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- |24738|29196| 1.0| 1.0| 1.0| null| 1| 1| 1| 1| 1| true|
- | 9904|89061| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- |29926|36578| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- |27815|46246| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- |71026|73461| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- |18812|54292| 1.0| 1.0| 1.0| null| 1| 1| 1| 1| 0| true|
- |20649|52511| 1.0| null| 0.875| null| 1| 1| 1| 1| 1| true|
- |39573|49314| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- | 4018| 5824| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- |16333|40015| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- | 4572| 4636| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- |16892|39791| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- |40334|74815| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- |39491|41781| 1.0| null| 1.0| null| 1| 1| 1| 1| 1| true|
- +-----+-----+------------+------------+------------+------------+-------+------+------+------+-------+--------+
- only showing top 20 rows
- root
- |-- id_1: integer (nullable = true)
- |-- id_2: integer (nullable = true)
- |-- cmp_fname_c1: double (nullable = true)
- |-- cmp_fname_c2: double (nullable = true)
- |-- cmp_lname_c1: double (nullable = true)
- |-- cmp_lname_c2: double (nullable = true)
- |-- cmp_sex: integer (nullable = true)
- |-- cmp_bd: integer (nullable = true)
- |-- cmp_bm: integer (nullable = true)
- |-- cmp_by: integer (nullable = true)
- |-- cmp_plz: integer (nullable = true)
- |-- is_match: boolean (nullable = true)
- +--------+-------+
- |is_match| count|
- +--------+-------+
- | false|5728201|
- | true| 20931|
- +--------+-------+
- +--------+-------+
- |is_match| cnt|
- +--------+-------+
- | false|5728201|
- | true| 20931|
- +--------+-------+
- +-------+------------------+-----------------+-------------------+------------------+-------------------+-------------------+-------------------+-------------------+-------------------+------------------+-------------------+
- |summary| id_1| id_2| cmp_fname_c1| cmp_fname_c2| cmp_lname_c1| cmp_lname_c2| cmp_sex| cmp_bd| cmp_bm| cmp_by| cmp_plz|
- +-------+------------------+-----------------+-------------------+------------------+-------------------+-------------------+-------------------+-------------------+-------------------+------------------+-------------------+
- | count| 5749132| 5749132| 5748125| 103698| 5749132| 2464| 5749132| 5748337| 5748337| 5748337| 5736289|
- | mean| 33324.48559643438|66587.43558331935| 0.71290247044366|0.9000176718903193|0.31562781930798406|0.31841283153174427| 0.955001381078048|0.22446526708507172|0.48885529849763504|0.2227485966810923|0.00552866147434343|
- | stddev|23659.859374488133|23620.48761326975|0.38875835961627936|0.2713176105782334| 0.3342336339615827| 0.3685670662006655|0.20730111116897806|0.41722972238462636| 0.4998758236779028|0.4160909629831758|0.07414914925420049|
- | min| 1| 6| 0.0| 0.0| 0.0| 0.0| 0| 0| 0| 0| 0|
- | max| 99980| 100000| 1.0| 1.0| 1.0| 1.0| 1| 1| 1| 1| 1|
- +-------+------------------+-----------------+-------------------+------------------+-------------------+-------------------+-------------------+-------------------+-------------------+------------------+-------------------+
- +-------+-------------------+------------------+
- |summary| cmp_fname_c1| cmp_fname_c2|
- +-------+-------------------+------------------+
- | count| 5748125| 103698|
- | mean| 0.71290247044366|0.9000176718903193|
- | stddev|0.38875835961627936|0.2713176105782334|
- | min| 0.0| 0.0|
- | max| 1.0| 1.0|
- +-------+-------------------+------------------+
- +------------+---------+--------------------+
- | field| total| delta|
- +------------+---------+--------------------+
- | id_1|5749132.0| 1255.8076310367542|
- | cmp_plz|5736289.0| 0.9563812499852176|
- |cmp_lname_c2| 2464.0| 0.8064147192926265|
- | cmp_by|5748337.0| 0.7762059675300512|
- | cmp_bd|5748337.0| 0.775442311783404|
- |cmp_lname_c1|5749132.0| 0.6838772482595057|
- | cmp_bm|5748337.0| 0.5109496938298685|
- |cmp_fname_c1|5748125.0| 0.28545290574606175|
- |cmp_fname_c2| 103698.0| 0.0910426806228013|
- | cmp_sex|5749132.0|0.032408185250332844|
- | id_2|5749132.0| -15383.483201807663|
- +------------+---------+--------------------+
- +-----+-----+-------+
- |above| true| false|
- +-----+-----+-------+
- | true|20871| 637|
- |false| 60|5727564|
- +-----+-----+-------+
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement