I was wondering if it is possible to use GPT-3 to translate text description of a circuit to any circuit design language program, which in turn can be used to make the circuit. If it is possible, what approach will you suggest?
This is rather something for V&L Models, training on associated texts with circuit images. Data which should be hard to come by. I doubt these models are yet capable of catching enough detail in pictures for producing the desired results. I mean results that dont dissolve is smoke when soldering the circuit.
Mapping from natural language to some formal description language of circuits (lets call it fdloc) is definitively possible, but you need a lot of training data on text basis, lets say more than 1k pairs of human written texts and the corresponding fdloc expression. Do you have this data? Then machine translation networks are all you need. Fine-tuning a large system might be enough, depending on how your fdloc is syntactically build, e.g. does it contain many chars that a normal GPT Model would just not recognize as tokens?
Alternatively, if you don't have this data and don't want to get rendered circuit images, you could try to Learn the soldering paths to the respective electric pieces by natural language understanding:
Just a draft:
- Use NER (Named Entity Recognition) to spot all electric components in the text.
- The text between these components most probably deals with how to connect the different capacitors etc., so you need to map these relations onto "paths" that you register as connections between your components, e.g. now solder the negative connector of the switch S1 to the blabla of the light bulb socket B2" or something comparable.
- Watch out! Its natural language, so even if its written in a dry and technical style, you will have to resolve co-reference, something like "now connect THIS to the output jack ...". I think you could extract some sort of a directed graph, which contains the components and the path descriptions of connections to all other components.
- From this you then need to build a schematic of the circuit. Alternatively, If you have something like a fdloc some program can read in and produce the circuit for you, then you don't need to do step 4 on your own.