Discrete default intensity based or logit type models are commonly used as reduced form models for conditional default probabilities for corporate loans where this default probability depends upon macroeconomic as well as rm-specic covariates. Typically, maximum likelihood (ML) methods are used to estimate the parameters associated with these models. Since defaults are rare, a large amount of data is needed for this estimation resulting in a computationally time consuming optimization. In this paper, we observe that since the defaults are typically rare, say, on average 1 ?? 2% per annum, under the Gaussian assumption on covariates (which may be achieved via transforming them), the rst order equations from ML estimation suggest a simple, accurate and intuitively appealing closed form estimator of the underlying parameters. To gain further insights, we analyze the properties of the proposed estimator as well as the ML estimator in a statistical asymptotic regime where the conditional probabilities decrease to zero, the number of rms as well as the data availability time period increases to innity. The covariates are assumed to evolve as a stationary Gaussian process. We characterize the dependence of the mean square error of the estimator on the number of rms as well as time period of available data. Our conclusion, validated by numerical analysis, is that when the underlying model is correctly specied, the proposed estimator is typically similar or only slightly worse than the ML estimator. Importantly however, since usually any model is misspecied due to hidden factor(s), then both the proposed and the ML estimator are equally good or equally bad! Further, in this setting, beyond a point, both are more-or-less insensitive to increase in data, in number of rms and in time periods of available data. This suggests that gathering excessive expensive data may add little value to model calibration. The proposed approximations should also have applications outside nance where logit type models are used and probabilities of interest are small.