In this dissertation, various analytical models to characterize fiber nonlinearities have been applied, and the ranges of validity of the models are determined by comparing with numerical results.

First, the perturbation approach is used to solve the nonlinear Schrödinger equation, and its range of validity is determined by comparing to the split-step Fourier method. In addition, it is shown mathematically that the perturbation approach is equivalent to the Volterra series approach. Secondly, root-mean-square (RMS) widths both in the time domain and in the frequency domain are modeled. It is shown that there exists an optimal input pulse width to minimize output pulse width based on the derived RMS models, and the functional form of the minimum output pulse width is derived. The response of a fiber to a sinusoidally modulated input which models an alternating bit sequence is studied to see its utility in measuring system performance in the presence of the fiber nonlinearities. In a single channel system, the sinusoidal response shows a strong correlation with eye-opening penalty in the normal dispersion region over a wide range of parameters, but over a more limited range in the anomalous dispersion region. The cross-phase modulation (CPM) penalty in a multi-channel system is also studied using the sinusoidally modulated input signal. The derived expression shows good agreement with numerical results in conventional fiber systems over a wide range of channel spacing, ∆f, and in dispersion-shifted fiber systems when ∆f > 100GHz. It is also shown that the effect of fiber nonlinearities may be characterized with stochastic input signals using noise-loading analysis. In a dense wavelength division multiplexed (DWDM) system where channels are spaced very closely, the broadened spectrum due to various nonlinear effects like SPM (self-phase modulation), CPM, and FWM (four-wave mixing) is in practice indistinguishable. In such a system, the noise-loading analysis could be useful in assessing the effects of broadened spectrum due to fiber nonlinearities on system performance. Finally, it is shown numerically how fiber nonlinearities can be utilized to improve system performance of a spectrum-sliced WDM system.

The major limiting factors of utilizing fiber nonlinearities are also discussed.