One idea could be to employ a program to impute the missing values. Some time ago I set up an example using the R package Amelia.
Please also note the additional links in the example. It is possible that in the meantime there are more advanced methods available. Also success might very much depend on how regular your missing numbers are missing and if a pattern can be established.