Geometry of neural networks and models with singularities
This paper discusses maximum likelihood estimation with unidentifiability of parameters. Unidentifiability is formulated as a conic singularity of the model. It is known that the likelihood ratio may have unusually large order in unidentifiable cases. A sufficient condition for such large order is given and applied to neural networks.