English language model

#############################################################################
## Copyright (c) 1996, Carnegie Mellon University, Cambridge University,
## Ronald Rosenfeld and Philip Clarkson
## Version 3, Copyright (c) 2006, Carnegie Mellon University
## Contributors includes Wen Xu, Ananlada Chotimongkol,
## David Huggins-Daines, Arthur Chan and Alan Black
#############################################################################
=============================================================================
===============  This file was produced by the CMU-Cambridge  ===============
===============     Statistical Language Modeling Toolkit     ===============
=============================================================================
This is a 3-gram language model, based on a vocabulary of 96 words,
  which begins "</s>", "<s>", "A"...
This is a CLOSED-vocabulary model
  (OOVs eliminated from training data and are forbidden in test data)
Good-Turing discounting was applied.
1-gram frequency of frequency : 69
2-gram frequency of frequency : 167 5 2 0 0 0 0
3-gram frequency of frequency : 198 2 2 0 0 0 0
1-gram discounting ratios : 0.99
2-gram discounting ratios : 0.02 0.59
3-gram discounting ratios : 0.00
This file is in the ARPA-standard format introduced by Doug Paul.

p(wd3|wd1,wd2)= if(trigram exists)           p_3(wd1,wd2,wd3)
                else if(bigram w1,w2 exists) bo_wt_2(w1,w2)*p(wd3|wd2)
                else                         p(wd3|w2)

p(wd2|wd1)= if(bigram exists) p_2(wd1,wd2)
            else              bo_wt_1(wd1)*p_1(wd2)

All probs and back-off weights (bo_wt) are given in log10 form.

Data formats:

Beginning of data mark: \data\
ngram 1=nr            # number of 1-grams
ngram 2=nr            # number of 2-grams
ngram 3=nr            # number of 3-grams

\1-grams:
p_1     wd_1 bo_wt_1
\2-grams:
p_2     wd_1 wd_2 bo_wt_2
\3-grams:
p_3     wd_1 wd_2 wd_3

end of data mark: \end\

\data\
ngram 1=96
ngram 2=175
ngram 3=202

\1-grams:
-0.9201 </s>	-1.3570
-0.9031 <s>	0.1548
-2.0170 A	-0.0068
-2.3243 ALWAYS	-0.0067
-2.3243 AM	-0.0089
-2.3243 AN	-0.0046
-1.8409 AND	0.0083
-2.3243 ARE	0.0105
-2.3243 AT	0.0127
-2.3243 BEING	-0.0089
-2.3243 BENEFIT	-0.0089
-2.3243 BETWEEN	0.0105
-2.3243 BOTTOM	-0.0025
-1.8409 BUT	-0.1971
-2.0170 CAN	-0.0004
-2.0170 CLIENT	0.0716
-2.0170 COMPANY	0.0470
-2.3243 CONDUCTING	0.0127
-2.3243 COOPERATION	0.0447
-2.3243 COULD	-0.0089
-2.3243 DID	-0.0089
-2.3243 DONE	-0.0089
-2.3243 END	-0.0046
-2.0170 EXPLAIN	0.0018
-2.3243 FEELS	-0.0067
-2.3243 FOR	-0.0025
-2.3243 FROM	0.0127
-2.3243 GET	0.0018
-2.3243 GIVE	0.0127
-2.3243 GLAD	-0.0025
-2.3243 GO	0.0447
-2.3243 GOING	0.0018
-2.3243 GOOD	-0.0089
-2.3243 HAPPENED	0.0447
-2.3243 HAVE	-0.0067
-2.3243 HOPE	0.0105
-1.7160 I	-0.0026
-2.3243 I'M	-0.0089
-2.3243 INFORMATION	0.0000
-1.8409 INTERVIEW	0.0591
-2.3243 INTERVIEWEE	-0.0046
-2.3243 INTJENNIFER	0.0447
-2.3243 INVESTIGATE	0.0447
-2.3243 INVESTIGATION	0.0447
-1.6191 IS	0.0126
-2.0170 LAWYER	0.0716
-2.3243 LAWYERS	-0.0089
-2.3243 LITTLE	-0.0089
-2.3243 LOT	-0.0025
-2.3243 MAIL	-0.0089
-2.3243 ME	0.0447
-2.3243 MEET	0.0105
-1.8409 MY	0.0018
-2.3243 NEED	0.0018
-2.3243 NICE	0.0018
-2.3243 NOT	-0.0089
-2.3243 NOW	0.0447
-1.7160 OF	0.0260
-2.3243 OK	-0.0025
-2.3243 OKAY	-0.0067
-2.3243 ONE	-0.0025
-2.3243 PLEASE	-0.0089
-2.3243 POTENTIAL	0.0447
-2.3243 PROBABLY	-0.0046
-2.3243 QUALIFICATIONS	0.0447
-2.3243 QUESTION	-0.0025
-2.0170 RELATIONSHIP	0.0083
-2.3243 RICHARD	0.0447
-2.3243 SCORE	-0.0089
-2.3243 SEAT	0.0447
-2.3243 SENT	0.0018
-2.3243 SERIOUSLY	0.0447
-2.3243 START	-0.0025
-2.3243 STAY	-0.0089
-2.3243 STILL	-0.0089
-2.3243 STRANGE	-0.0046
-2.3243 TAKEN	-0.0089
-2.0170 THANK	-0.3607
-2.3243 THAT	0.0018
-2.3243 THAT'S	-0.0089
-1.2767 THE	-0.0243
-1.7160 THIS	0.0616
-1.5399 TO	0.0306
-2.3243 TRUE	-0.0046
-1.8409 UPJOHN	-0.6927
-1.8409 WARNING	-0.6434
-2.3243 WELCOME	-0.0067
-2.0170 WHAT	-0.0025
-2.3243 WHO	-0.0004
-1.7160 WITH	0.0447
-2.3243 WITNESSES	0.0447
-2.3243 WORKING	-0.0025
-2.3243 YES	0.0447
-1.3181 YOU	0.0526
-2.3243 YOU'RE	-0.0089
-1.7160 YOUR	0.0017

\2-grams:
-0.0170 </s> <s> 0.0254
-3.0361 <s> </s> 1.4150
-3.0361 <s> ARE 0.0109
-3.0361 <s> AT 0.0109
-3.0361 <s> END 0.0109
-3.0361 <s> GOOD 0.0109
-3.0361 <s> I 0.0027
-3.0361 <s> IS 0.0022
-3.0361 <s> LOT 0.0109
-3.0361 <s> NICE 0.0109
-3.0361 <s> OK 0.0109
-3.0361 <s> OKAY 0.0109
-3.0361 <s> PLEASE 0.0109
-3.0361 <s> PROBABLY 0.0109
-3.0361 <s> SCORE 0.0109
-3.0361 <s> THANK 0.3820
-3.0361 <s> THAT'S 0.0109
-3.0361 <s> THE 0.0010
-0.9542 <s> UPJOHN 0.2218
-3.0361 <s> WHAT 0.0054
-3.0361 <s> WITNESSES 0.0109
-3.0361 <s> WORKING 0.0109
-3.0361 <s> YES 0.0109
-3.0361 <s> YOU 0.0011
-3.0361 <s> YOU'RE 0.0109
-3.0361 <s> YOUR 0.0027
-1.9058 A LITTLE 0.0109
-1.9058 A SEAT 0.0109
-1.6048 ALWAYS EXPLAIN 0.0054
-1.6048 AM ONE 0.0109
-1.6048 AN INTERVIEW 0.0036
-2.0819 AND ME 0.0109
-2.0819 AND WITH 0.0027
-2.0819 AND YOUR 0.0027
-1.6048 ARE YOU 0.0011
-1.6048 AT THE 0.0010
-1.6048 BEING TAKEN 0.0109
-1.6048 BENEFIT FROM 0.0109
-1.6048 BETWEEN YOU 0.0540
-1.6048 BOTTOM OF 0.0027
-2.0819 BUT I'M 0.0109
-0.4089 BUT YOU 0.0022
-1.9058 CAN I 0.0027
-1.9058 CAN MAIL 0.0109
-1.9058 CLIENT </s> 1.4150
-1.9058 CLIENT THE 0.0488
-1.9058 COMPANY </s> 1.4150
-1.9058 COMPANY SENT 0.0109
-1.6048 CONDUCTING THE 0.0010
-1.6048 COOPERATION </s> 1.4150
-1.6048 COULD STILL 0.0109
-1.6048 DID NOT 0.0109
-1.6048 DONE NOW 0.0109
-1.6048 END INTERVIEW 0.0036
-1.9058 EXPLAIN WHAT 0.0054
-1.9058 EXPLAIN YOUR 0.0027
-1.6048 FEELS A 0.0054
-1.6048 FOR YOUR 0.0027
-1.6048 FROM THE 0.0010
-1.6048 GET TO 0.0018
-1.6048 GIVE THE 0.0010
-1.6048 GLAD THIS 0.0027
-1.6048 GO </s> 1.4150
-1.6048 GOING TO 0.0018
-1.6048 GOOD QUESTION 0.0109
-1.6048 HAPPENED </s> 1.4150
-1.6048 HAVE A 0.0054
-1.6048 HOPE YOU 0.0011
-2.2068 I AM 0.0109
-2.2068 I GO 0.0109
-2.2068 I HOPE 0.0109
-2.2068 I NEED 0.0109
-1.6048 I'M GLAD 0.0109
-2.0819 INTERVIEW </s> 1.4150
-2.0819 INTERVIEW ALWAYS 0.0109
-2.0819 INTERVIEW IS 0.0022
-1.6048 INTERVIEWEE AND 0.0036
-1.6048 INTJENNIFER </s> 1.4150
-1.6048 INVESTIGATE </s> 1.4150
-1.6048 INVESTIGATION </s> 1.4150
-2.3037 IS BEING 0.0109
-2.3037 IS CONDUCTING 0.0109
-2.3037 IS DONE 0.0109
-2.3037 IS THIS 0.0027
-2.3037 IS WITH 0.0027
-1.9058 LAWYER </s> 1.4150
-1.9058 LAWYER THE 0.0488
-1.6048 LAWYERS WHO 0.0109
-1.6048 LITTLE STRANGE 0.0109
-1.6048 LOT OF 0.0027
-1.6048 MAIL THAT 0.0109
-1.6048 ME </s> 1.4150
-1.6048 MEET YOU 0.0011
-2.0819 MY CLIENT 0.0054
-2.0819 MY LAWYER 0.0054
-2.0819 MY RELATIONSHIP 0.0054
-1.6048 NEED TO 0.0018
-1.6048 NICE TO 0.0018
-1.6048 NOT GIVE 0.0109
-1.6048 NOW </s> 1.4150
-2.2068 OF AN 0.0109
-2.2068 OF POTENTIAL 0.0109
-2.2068 OF THE 0.0010
-2.2068 OF THIS 0.0027
-1.6048 OK THIS 0.0027
-1.6048 OKAY THANK 0.3820
-1.6048 ONE OF 0.0027
-1.6048 PLEASE HAVE 0.0109
-1.6048 POTENTIAL </s> 1.4150
-1.6048 PROBABLY BUT 0.2147
-1.6048 QUALIFICATIONS </s> 1.4150
-1.6048 QUESTION I 0.0027
-1.9058 RELATIONSHIP IS 0.0022
-1.9058 RELATIONSHIP WITH 0.0027
-1.6048 RICHARD </s> 1.4150
-1.6048 SCORE INTJENNIFER 0.0109
-1.6048 SEAT </s> 1.4150
-1.6048 SENT TO 0.0018
-1.6048 SERIOUSLY </s> 1.4150
-1.6048 START OF 0.0027
-1.6048 STAY BETWEEN 0.0109
-1.6048 STILL BENEFIT 0.0109
-1.6048 STRANGE BUT 0.0036
-1.6048 TAKEN SERIOUSLY 0.0109
-0.2328 THANK YOU 0.0022
-1.6048 THAT TO 0.0018
-1.6048 THAT'S TRUE 0.0109
-2.6462 THE BOTTOM 0.0109
-0.9731 THE COMPANY 0.0109
-2.6462 THE INFORMATION 0.0556
-2.6462 THE INTERVIEW 0.0036
-2.6462 THE INTERVIEWEE 0.0109
-2.6462 THE INVESTIGATION 0.0109
-2.6462 THE LAWYER 0.0054
-2.6462 THE LAWYERS 0.0109
-2.6462 THE START 0.0109
-2.6462 THE UPJOHN 0.6990
-2.2068 THIS </s> 1.4150
-2.2068 THIS FEELS 0.0109
-2.2068 THIS GOING 0.0109
-2.2068 THIS IS 0.0022
-2.3829 TO EXPLAIN 0.0054
-2.3829 TO INVESTIGATE 0.0109
-2.3829 TO MEET 0.0109
-2.3829 TO MY 0.0036
-2.3829 TO STAY 0.0109
-2.3829 TO THE 0.0010
-1.6048 TRUE BUT 0.2147
-0.0969 UPJOHN WARNING 0.0969
-0.0969 WARNING </s> 0.8129
-1.6048 WELCOME CAN 0.0054
-1.9058 WHAT HAPPENED 0.0109
-1.9058 WHAT MY 0.0036
-1.6048 WHO IS 0.0022
-2.2068 WITH MY 0.0036
-2.2068 WITH RICHARD 0.0109
-2.2068 WITH THE 0.0010
-2.2068 WITH YOU 0.0540
-1.6048 WITNESSES </s> 1.4150
-1.6048 WORKING WITH 0.0027
-1.6048 YES </s> 1.4150
-2.6048 YOU </s> 1.4150
-0.9317 YOU AND 0.0073
-2.6048 YOU CAN 0.0054
-2.6048 YOU COULD 0.0109
-2.6048 YOU DID 0.0109
-2.6048 YOU FOR 0.0109
-2.6048 YOU GET 0.0109
-2.6048 YOU I 0.0027
-2.6048 YOU THE 0.0010
-1.6048 YOU'RE WELCOME 0.0109
-2.2068 YOUR CLIENT 0.0054
-2.2068 YOUR COOPERATION 0.0109
-2.2068 YOUR QUALIFICATIONS 0.0109
-2.2068 YOUR RELATIONSHIP 0.0054

\3-grams:
-99.9990 </s> <s> ARE
-99.9990 </s> <s> AT
-99.9990 </s> <s> END
-99.9990 </s> <s> GOOD
-99.9990 </s> <s> I
-99.9990 </s> <s> IS
-99.9990 </s> <s> LOT
-99.9990 </s> <s> NICE
-99.9990 </s> <s> OK
-99.9990 </s> <s> OKAY
-99.9990 </s> <s> PLEASE
-99.9990 </s> <s> PROBABLY
-99.9990 </s> <s> SCORE
-99.9990 </s> <s> THANK
-99.9990 </s> <s> THAT'S
-99.9990 </s> <s> THE
-1.0969 </s> <s> UPJOHN
-99.9990 </s> <s> WHAT
-99.9990 </s> <s> WITNESSES
-99.9990 </s> <s> WORKING
-99.9990 </s> <s> YES
-99.9990 </s> <s> YOU
-99.9990 </s> <s> YOU'RE
-99.9990 </s> <s> YOUR
-99.9990 <s> </s> <s>
-99.9990 <s> ARE YOU
-99.9990 <s> AT THE
-99.9990 <s> END INTERVIEW
-99.9990 <s> GOOD QUESTION
-99.9990 <s> I AM
-99.9990 <s> IS THIS
-99.9990 <s> LOT OF
-99.9990 <s> NICE TO
-99.9990 <s> OK THIS
-99.9990 <s> OKAY THANK
-99.9990 <s> PLEASE HAVE
-99.9990 <s> PROBABLY BUT
-99.9990 <s> SCORE INTJENNIFER
-99.9990 <s> THANK YOU
-99.9990 <s> THAT'S TRUE
-99.9990 <s> THE INTERVIEW
-0.1761 <s> UPJOHN WARNING
-99.9990 <s> WHAT HAPPENED
-99.9990 <s> WITNESSES </s>
-99.9990 <s> WORKING WITH
-99.9990 <s> YES </s>
-99.9990 <s> YOU DID
-99.9990 <s> YOU'RE WELCOME
-99.9990 <s> YOUR QUALIFICATIONS
-99.9990 A LITTLE STRANGE
-99.9990 A SEAT </s>
-99.9990 ALWAYS EXPLAIN YOUR
-99.9990 AM ONE OF
-99.9990 AN INTERVIEW ALWAYS
-99.9990 AND ME </s>
-99.9990 AND WITH MY
-99.9990 AND YOUR CLIENT
-99.9990 ARE YOU THE
-99.9990 AT THE START
-99.9990 BEING TAKEN SERIOUSLY
-99.9990 BENEFIT FROM THE
-99.9990 BETWEEN YOU AND
-99.9990 BOTTOM OF THIS
-99.9990 BUT I'M GLAD
-99.9990 BUT YOU CAN
-99.9990 BUT YOU COULD
-99.9990 CAN I GO
-99.9990 CAN MAIL THAT
-99.9990 CLIENT </s> <s>
-99.9990 CLIENT THE COMPANY
-99.9990 COMPANY </s> <s>
-99.9990 COMPANY SENT TO
-99.9990 CONDUCTING THE INVESTIGATION
-99.9990 COOPERATION </s> <s>
-99.9990 COULD STILL BENEFIT
-99.9990 DID NOT GIVE
-99.9990 DONE NOW </s>
-99.9990 END INTERVIEW </s>
-99.9990 EXPLAIN WHAT MY
-99.9990 EXPLAIN YOUR RELATIONSHIP
-99.9990 FEELS A LITTLE
-99.9990 FOR YOUR COOPERATION
-99.9990 FROM THE INFORMATION
-99.9990 GET TO THE
-99.9990 GIVE THE UPJOHN
-99.9990 GLAD THIS IS
-99.9990 GO </s> <s>
-99.9990 GOING TO STAY
-99.9990 GOOD QUESTION I
-99.9990 HAPPENED </s> <s>
-99.9990 HAVE A SEAT
-99.9990 HOPE YOU GET
-99.9990 I AM ONE
-99.9990 I GO </s>
-99.9990 I HOPE YOU
-99.9990 I NEED TO
-99.9990 I'M GLAD THIS
-99.9990 INTERVIEW </s> <s>
-99.9990 INTERVIEW ALWAYS EXPLAIN
-99.9990 INTERVIEW IS DONE
-99.9990 INTERVIEWEE AND YOUR
-99.9990 INTJENNIFER </s> <s>
-99.9990 INVESTIGATE </s> <s>
-99.9990 INVESTIGATION </s> <s>
-99.9990 IS BEING TAKEN
-99.9990 IS CONDUCTING THE
-99.9990 IS DONE NOW
-99.9990 IS THIS GOING
-99.9990 IS WITH YOU
-99.9990 LAWYER </s> <s>
-99.9990 LAWYER THE COMPANY
-99.9990 LAWYERS WHO IS
-99.9990 LITTLE STRANGE BUT
-99.9990 LOT OF POTENTIAL
-99.9990 MAIL THAT TO
-99.9990 ME </s> <s>
-99.9990 MEET YOU </s>
-99.9990 MY CLIENT THE
-99.9990 MY LAWYER </s>
-99.9990 MY RELATIONSHIP IS
-99.9990 NEED TO EXPLAIN
-99.9990 NICE TO MEET
-99.9990 NOT GIVE THE
-99.9990 NOW </s> <s>
-99.9990 OF AN INTERVIEW
-99.9990 OF POTENTIAL </s>
-99.9990 OF THE LAWYERS
-99.9990 OF THIS </s>
-99.9990 OK THIS FEELS
-99.9990 OKAY THANK YOU
-99.9990 ONE OF THE
-99.9990 PLEASE HAVE A
-99.9990 POTENTIAL </s> <s>
-99.9990 PROBABLY BUT YOU
-99.9990 QUALIFICATIONS </s> <s>
-99.9990 QUESTION I NEED
-99.9990 RELATIONSHIP IS WITH
-99.9990 RELATIONSHIP WITH THE
-99.9990 RICHARD </s> <s>
-99.9990 SCORE INTJENNIFER </s>
-99.9990 SEAT </s> <s>
-99.9990 SENT TO INVESTIGATE
-99.9990 SERIOUSLY </s> <s>
-99.9990 START OF AN
-99.9990 STAY BETWEEN YOU
-99.9990 STILL BENEFIT FROM
-99.9990 STRANGE BUT I'M
-99.9990 TAKEN SERIOUSLY </s>
-99.9990 THANK YOU FOR
-99.9990 THANK YOU I
-99.9990 THAT TO MY
-99.9990 THAT'S TRUE BUT
-99.9990 THE BOTTOM OF
-99.9990 THE COMPANY </s>
-99.9990 THE COMPANY SENT
-99.9990 THE INFORMATION </s>
-99.9990 THE INTERVIEW IS
-99.9990 THE INTERVIEWEE AND
-99.9990 THE INVESTIGATION </s>
-99.9990 THE LAWYER THE
-99.9990 THE LAWYERS WHO
-99.9990 THE START OF
-99.9990 THE UPJOHN WARNING
-99.9990 THIS </s> <s>
-99.9990 THIS FEELS A
-99.9990 THIS GOING TO
-99.9990 THIS IS BEING
-99.9990 TO EXPLAIN WHAT
-99.9990 TO INVESTIGATE </s>
-99.9990 TO MEET YOU
-99.9990 TO MY LAWYER
-99.9990 TO STAY BETWEEN
-99.9990 TO THE BOTTOM
-99.9990 TRUE BUT YOU
-0.1249 UPJOHN WARNING </s>
-0.1249 WARNING </s> <s>
-99.9990 WELCOME CAN I
-99.9990 WHAT HAPPENED </s>
-99.9990 WHAT MY RELATIONSHIP
-99.9990 WHO IS CONDUCTING
-99.9990 WITH MY CLIENT
-99.9990 WITH RICHARD </s>
-99.9990 WITH THE INTERVIEWEE
-99.9990 WITH YOU AND
-99.9990 WITNESSES </s> <s>
-99.9990 WORKING WITH RICHARD
-99.9990 YES </s> <s>
-99.9990 YOU </s> <s>
-99.9990 YOU AND ME
-99.9990 YOU AND WITH
-99.9990 YOU CAN MAIL
-99.9990 YOU COULD STILL
-99.9990 YOU DID NOT
-99.9990 YOU FOR YOUR
-99.9990 YOU GET TO
-99.9990 YOU I HOPE
-99.9990 YOU THE LAWYER
-99.9990 YOU'RE WELCOME CAN
-99.9990 YOUR CLIENT </s>
-99.9990 YOUR COOPERATION </s>
-99.9990 YOUR QUALIFICATIONS </s>
-99.9990 YOUR RELATIONSHIP WITH

\end\