Also see Relationship between Mathematics and Physics - https://en.wikipedia.org/wiki/Relationship_between_mathemati...

There's a quote Atiyah has about spin geometry which he heard from his advisor Hodge, who had an office next to Dirac at Cambridge.

Only two people understand spinors: God, and Dirac. And Dirac's dead.

Yes, vaguely related. Dirac is not wondering why measurement itself works, but why mathematical reasoning applies so effectively to the measurement results.

I think it's valid to be surprised that all observations of a physical phenomena up until this point have obeyed a beautiful and (relatively) simple mathematical relationship, without even thinking about predicting the future.

Measurement works because universe moves in a simple way. As Hume indicates, you need very complex motion for irregularity, maybe even sentient, but sentient universe is fairy tale.

Math, Science, ..., certainly not God

Pretty much everyone worships some sort of God. (The exceptions are non-self-aware people living moment-to-moment.)

What people argue about is the degree of personality and autonomy that God possesses.

There is no logical reason why the second method should be possible at all,

One reason I can think of is if we consider that some regularity in the physical behavior is required for consciousness to evolve and so consciousness only forms in such worlds.

Later down in the essay, Dirac himself answers this;

With this kind of cosmological picture one is led to suppose that there was a beginning of time, and that it is meaningless to inquire into what happened before then. One can get a rough idea of the geometrical relationships this involves by imagining the present to be the surface of a sphere, going into the past to be going in towards the centre of the sphere, and going into the future to be going outwards. There is then no limit to how far one may go into the future, but there is a limit to how far one can go into the past, corresponding to when one has reached the centre of the sphere. The beginning of time provides a natural origin from which to measure the time of any event. The result is usually called the epoch of that event. Thus the present epoch is 2 x 109 years [actually 2x10^9].

One further point in connection with the new cosmology is worthy of note. At the beginning of time the laws of Nature were probably very different from what they are now. Thus we should consider the laws of Nature as continually changing with the epoch, instead of as holding uniformly throughout space-time. This idea was first put forward by Milne, who worked it out on the assumptions that the universe at a given epoch is roughly everywhere uniform and spherically symmetrical. I find these assumptions not very satisfying, because the local departures from uniformity are so great and are of such essential importance for our world of life that it seems unlikely there should be a principle of uniformity overlying them. Further, as we already have the laws of Nature depending on the epoch, we should expect them also to depend on position in space, in order to preserve the beautiful idea of the theory of relativity there is fundamental similarity between space and time. This goes more drastically against Milne's assumptions than a mere lack of uniformity in the distribution of matter.

Show respect to Mathematicians/Physicists/etc. many of whom had studied Philosophy and i dare say had a better understanding/insight of it than mere academic Philosophers. Why? Because they don't go off into la-la land but try very hard to have both observed evidence and a mathematical model of it match cleanly via a Theory.

For your edification, read first "Meditations on First Philosophy by Rene Descartes" followed by "Physics and Philosophy by Werner Heisenberg".

unwritten rules

but as time goes on it becomes increasingly evident that the rules which the mathematician finds interesting are the same as those which Nature has chosen

This is quantifiable, right? Should be possible to measure how many mathematicians favor ideas like turbulence, macroscopic quantum physics, anthropic principle, analog geometry, finitism. I think, mathematics doesn't really try to match physics yet.

Related;

From Heisenberg to Goedel via Chaitin - https://arxiv.org/abs/quant-ph/0402197

Correct (but now we know it should be somewhat higher than that), and 1039 should be 10^39, one of Dirac's Large Numbers, the size of the observable universe in atomic units, and also the ratio of electromagnetic to gravitational forces in the hydrogen atom.

The dominating idea in this application of mathematics to physics is that the equations representing the laws of motion should be of a simple form. The whole success of the scheme is due to the fact that equations of simple form do seem to work. The physicist is thus provided with a principle of simplicity, which he can use as an instrument of research.

https://arxiv.org/abs/math-ph/0009007

Occam's Razor as a Formal Basis for a Physical Theory

We introduce the principle of Occam's Razor in a form which can be used as a basis for economical formulations of physics. This allows us to explain the general structure of the Lagrangian for a composite physical system, as well as some other artificial postulates behind the variational formulations of physical laws. As an example, we derive Hamilton's principle of stationary action together with the Lagrangians for the cases of Newtonian mechanics, relativistic mechanics and a relativistic particle in an external gravitational field.

Now dive down into Math with Penrose and David Bohm with the implicate order.