EN
DE
ES
FR
Precision Resistors
Resistors for very high accuracy
Guide Precision Resistors
Index
What is a precision resistor?
Measuring resistors are ohmic resistors which have to meet the particularly high requirements of precision measurement technology. Therefore, they are precision resistors without exception. They are used for current and voltage measurement and are usually used in voltage divider circuits. Because of their precise, stable resistance value, currents can be measured accurately if the voltage is known exactly (and vice versa). Depending on the application, different types of precision resistors are suitable for this task. Among them are special power resistors and shunt resistors, which are suitable for applications with high voltages and/or currents. The design can be very different and the term measurement resistor is used when the application is about solving a measurement task.
Tips for precision resistors
The range of measuring resistors and the application field are so broad that a simple statement about which resistor is suitable and when cannot be answered in a generalized way. One can generalize the technological characteristics due to the respective design.
Due to their design, measuring resistors with resistive elements made of wire (i.e. wirewound resistors) have an inductance that limits their use at high frequencies. Special winding procedures are used here to attempt to reduce this effect significantly at the relevant frequencies in the application. They offer the best possibility to achieve an exact resistance value with very good resistance tolerances. This advantage is therefore especially useful when a special value of the total resistance has to be achieved which is not available as standard product. However, if this is not required, metal foil and metal film resistors are usually the better choice today because they do not have these frequency effects. However, on the one hand the working temperature range is limited compared to wire elements and not all of them are suitable for higher power consumption.
Features of a precision resistor
Simply put, a precision resistor is a "more accurate" resistor compared to conventional products that are available in bulk. In addition to the generally higher quality requirements, the following main characteristics are decisive for the use of the term "precision resistor", depending on the design, in order to distinguish these resistors from "standard goods" or "mass-produced goods":
- Much tighter resistance tolerances
- Production of precise resistance values according to requirements / function
- Lower temperature coefficient (TK value)
- Far better long-term behaviour
- Larger special temperature ranges (partly up to 300 °C)
- Reduced current noise
- Suppression of inductance and/or capacitance effects
- Special housings / connections Four-wire or Kelvin measuring method
Depending on the technology and method, the better tolerance is achieved by material selection or by selection. The temperature coefficient, on the other hand, is a material property throughout. A better long-term behaviour is achieved by using high-quality materials and by artificial ageing or preloading.
| Example NC550 @ 100 kΩ | Conventional carbon film resistor "Noname" @100 kΩ | |
 |  | |
| Resistance tolerance | 0.05% | ±5% |
| Temperature coefficient TC | ±3 ppm / °C | -700 up to 0 ppm / °C |
| Technology / Material | Metal film / NiCr alloy | Carbon layer |
The table shows a comparison of a precision wirewound resistor of our product range with a conventional, comparable carbon film resistor.
Precision resistor types
In our portfolio for resistors you will find exclusively fixed resistors. This means that our resistors are selected according to a fixed ohmic value. Variable resistors, if you like, can be found in our portfolio for potentiometers. However, we recommend not to use these products as variable resistors.
Basically all our resistors are precision resistors due to their quality, function and performance, and are suitable for many applications. The narrow resistance tolerances, precisely selectable ohmic values, as well as the stability and long-term behaviour clearly differentiate them from standard resistors.
We offer fixed resistors in the following technologies:
- Wirewound resistors
- Metal film resistors
- Metal foil resistors
- Full metal resistors
Measuring resistors are used as "standard" in current and voltage measurement applications. By their very nature, these measuring resistors are precision resistors and must be very accurate. With peak values of up to ±0.005% in resistance tolerance and a temperature coefficient of < ±1 ppm/°C, these ultra-precision resistors are designed for high-precision instrumentation.
Crossing almost all resistor technologies, precision resistors can be manufactured to the required accuracy as power resistors, voltage dividers, shunts or SMDs. Precision resistors are often bespoke components, tailored to the exact requirements of the application.
As part of our "Resistor Engineering" service, we can advise you on the best functional and economic solution. With assured product quality and delivery reliability, we focus on long-term partnerships and will support you throughout the life of your application.