Lecture 3 - Introduction to Robustness

Video Statistics and Information

Video
Captions Word Cloud
Reddit Comments
Captions
In a discreet sense, I am going to describe a quantity called ‘robustness’, and then the connection between quality and robustness will be explained. What does the word ‘robustness’ mean? Usually people, be it learned or not learned or engineers or scientists have a habit of using these words: quality, robustness, reliability and durability synonymously. As a matter of fact, we will see that durability is a subset of quality, and reliability is also a subset of quality in one sense. What do you think robustness is? Your opinion, your thoughts about it… Student 1: Strength of a product. Student 2: Maybe, how the product is performing under different environmental conditions. Student 3: Efficiency. It can be any of these three answers or it could be a combination of that, but the answer product performance under different environmental conditions is very close to the actual perspective of what robustness is but then you have to change the words to make it more precise. What robustness says is; irrespective of variations in the input, the output can vary only within allowed specification or tolerance. There are ‘n’ number of variables that are going to vary, we observed that they could be aleatoric uncertainties, which means there is inherent randomness or the uncertainty could be epistemic which means you might be able to control it. But there is uncertainty, which is going to propagate through the model which in turn affects the performance. Irrespective of the variability in your input my output variability should be minimal or it should be within the limits that I prescribed. So, this goes back to our example; that if I am a two-wheeler seller. I sell a bike to you, a motorbike. And then I promise ‘x’ kilometers per liter. You drive it and then you figure out that it is x minus 15 kilometers per liter. What will you say when you come for the first service? You are going to say that you have cheated me, because it is heavily deviating from what we promised. Then I ask you where did you drive it? You said, “Oh, I actually drove it in Bangalore.” Then if I say, “No, no. This engine was designed to operate in Chennai. So, you can only drive it in the roads of Adyar or Velachery, if you drive elsewhere we cannot promise this.” Is that an acceptable statement? It is not an acceptable statement. For whatever reason I just gave the example of Bangalore, it could be anywhere else, it can be Kashmir. So, irrespective of the temperature, irrespective of what kind of a rider you are, irrespective of what roads you have driven, irrespective of where you went and pumped your petrol, irrespective of any input condition that would influence the efficiency or the mileage of my vehicle. Your vehicle is expected to give minimal variation, plus or minus of what I promised. I promised x kilometer per liter I understand plus or minus few kilometer is acceptable. If I give like 50 kilometers per liter and my engine is giving you only 35 kilometers per liter you are going to be a heavily disappointed person. So, that is the key idea of robustness, this is more from a conceptual perspective, but how do you achieve it? Irrespective of the variability in the input my variability in the output should be minimal or within the specification that I state that’s one part of it. The second part is you don’t touch the cause for variation, you still live with the cause for variation, but you minimize the variation in the output. That is the important part. For instance the dealer understood the variation in the mileage was because of the roads in which you drove. So, Can he say? Sir, you cannot drive the vehicle in the gullies, you can only ride the vehicle in the highways. He cannot say that, he should tune the engine to an extent that irrespective of whatever road you drive, it should still give you close to 50 kilometers per liter. So, you cannot get rid of the source of variation, you have to live with the source of variation, but still make sure your output does not vary more than the specified limit. Figure 1. Brick Kiln We will discuss an example here, which will drive this point home. So, here is a Kiln (Fig. 1), Kiln which means a furnace. It is being used to make tiles. There is a burner and this is the wall of the Kiln and these are the the tiles that are being produced. You know how the bricks are usually done. There is some molten mixture, cut into cakes and it is placed and then it is burnt. This furnace is a bit advanced. So, to make the problem little spicy, what I have done is; I say that this machine was bought out of Germany or some other country. Don’t worry about where it was bought out of. And you cannot make any changes to the furnace, because the moment you make changes to the design the furnace the warranty is void. There was a problem when people started using this furnace, what happened was; the output tiles that came out were of irregular size. If you see the tiles that we usually have, they are 1x1 (one foot by one foot) right? So, imagine I give you 10 tiles to lay. One is 1x1.2, the other one is 1x0.8 and the other one is 0.8x1. So, I give you tiles of different sizes, you think you can lay it? You cannot. So, this is something that we might not have really realized all these days. If you get down to the floor and then you look at them they are all in a very straight line. Actually, if we observe them very closely there will be small deviations. Very small deviations will be there, that’s why they use the white color bonding material or whatever the tile color is, corresponding bonding material will be used so that you will not be able to see the difference. But there will be this minor difference which when you stand and see with the naked eyes you will not find. You will have to lie parallel to the tile and then you should be able to see. Figure 2. Central Tiles (highlighted) in Brick Kiln So this irregularity in tiles that we are talking about here is much larger than that, 0.8x1 is visually apparent, you can see the difference with the naked eyes. But I know the cause for the irregularity in tile sizes. The cause is that the tiles in the central part are exposed to a lower temperature compared to the ones on the outside which means there is a temperature gradient, there is no uniform temperature. There is a burner and the way in which it functions is, there is a gradient of temperature. As a result, the tiles when they come out they are of different sizes. What do you think can be done to address this problem? You cannot change the Kiln because it is very expensive and you have bought it from Germany. You cannot go and change any part of the Kiln, because the moment you make changes to it, its warranty is void, these are the constraints. Yeah? It’s better to not put the tiles in the middle where the temperature gradient is low… Ok so given the assumption that you know the gradient of the temperature, what he says is; let’s remove the central one so that the bricks that are exposed to the low temperature are not, you know they are not exposed at all, I mean they are not there. Yes, it is a potential solution, but also remember that this is only a representative figure. I will make the problem slightly challenging. Imagine there are about 9 columns instead of three, and then 9 columns from a projection and 9 columns deep also. So, it is about a 9 by 9 so you have about 81 and the central 3 represent the center. So, you are talking about 3 times 9, 27. So, let’s say about 10 brick height or tiles high is what the each column is, then you are talking about 270 to 300 tiles, less in productivity each time that you are you will have to open the furnace and close it, which is why you have gone to Germany and bought this, it is very expensive, but it also gives you a very good productivity, ok, but that answer is acceptable. But what I am saying is you still want the full productivity right. So, you do not want to remove this one, what else? Suppose you alter the rows that are burnt with Oh no, no, that you cannot do, see basically this is like baking, ok. You open the oven, you put the dough inside and you close it. You open and then you take the made out bread. You cannot just open it in-between and put some cherries and then close. Once done put it then take it once it is done. So, I otherwise also it is not that easy to handle the hot brick, ok, and yeah then? It is symmetric so you can check one kind of property, can choose that rows or columns or something And do what? We can like, usually predict the results. No, I know the results, I know that meaning; that is when I can do what he told right I know the temperature gradient; if you have noticed clearly I use the word assuming that we know the temperature gradient. I know that this is going to come out with 0.8. I know that will come at 1 that I know. Before coming out you know that this is going to be 0.8, this is going to be 1, this is going to be 1.2 that I know, but how do you deal with the problem. Because I want all of them to be of the same size more or less. Can the bed be moving type? The burner… Yes and yes and no, but what I am saying is let us say it is yes, it is already there and with that you feel this problem, ok. So, if it is no. Fine, it’s no. With that you find this problem; meaning you cannot change it now, if it is static it is static you cannot say let us go and rotate. No you cannot touch the furnace. Increase the temperature. Oh the other one will become even smaller, from 0.8 it will become 0.5, you won’t know whether it is a tile or it is a stone. You understand what I am saying right? When you increase there is a gradient, the gradient will go like this, the gradient will only translate. Increase the time. Time? Temperature will be uniform. No it will not, that is what I am saying the gradient, it will maintain the gradient for whatever reason. We can insulate the tiles… um… We can design it the way that positive part are on the outside of the same size; so, we can use multiple designs and accommodate… That is one way of looking at it. So, what he is saying is; since we know what is going to be the output size why cut them all to the same size, why will you cut all of them to 0.8 by 0.8. If you think that this guy is going to be larger than what you expect, 1.2, then you cut it smaller so that when he instead of being 1.2 he will become 1. Similarly, the ones who which go in the center, you cut it of a larger size and then he will come to 1, ok. That is an acceptable solution, but still you have to do some kind of a pre processing you need to understand you need to correlate and then you need to, but that is an accepted solution, what else? Yeah, see in this whole thing the solution that you give is fine. But I also want you to understand an important underlying idea about robustness, ok, that is, that is; coming in terms of the constraint. In another couple of minutes you will understand what I am talking about, ok, but I want you to appreciate that while you are trying to give the solution. Anything else? Any other solution that you can think of? Ok. So, these are fair enough solutions that you have given from a data perspective because that is all I have told you right? But you can also go into the physics of the problem a little bit which I don’t expect, but it is a trivial thing if you look at it. You know how these bricks are made? What are the major components of the bricks? And, why temperature is going to influence the size? Do you know? Because what I am saying is that’s all right. What is the problem here? It says no uniform temperature, why should the uniform temperature or no uniform temperature influence the size of your tile? What plays the role here? The temperature plays a role, what will happen if I am going to heat something; if I am going to heat something what will happen? They will contract? and if you heat something they will contract, is it? Depends on the material. Depends on the material right, but in this material what will happen? Whether it expands or contracts there is a property of the material that will play a role, what is that material; no sorry what is the property, you told just now. Thermal expansion. It is a coefficient of. Thermal. Thermal expansion, ok, there is some material that might expand this much, there is some material that might only expand this much. How do I describe that? Using the coefficient of thermal expansion. That plays a role here. What it is saying is; there is a material, this is the coefficient of thermal expansion, but what is happening is; there is a ?? that ??? is what the term is right? The ?? is large in the ones that are in the corner compared to the ones in the center. Hence, they will expand more compared to the ones in the center. One way to deal with that would be to check out what is the size and then do it, the other one will be to look at the material itself because the material that goes into it is your input it is not part of the furnace. If you know the physics of it, basically lime and clay are the material that go into it. What I will do is; I will play around with the composition (because there are two materials) such that the coefficient of thermal expansion matches the gradient. So, it will have a large coefficient of thermal expansion at the center and it will have a less coefficient of thermal expansion towards the end in such a gradient that it will match the temperature gradient. So, you can go ahead and do that, but this is also pre processing only, you should know you should do some experiments to understand how to do that. This is just an example to drive home the point on robustness. Now let me ask you the question, what was the source of randomness in this or source of uncertainty in this? Source of the error in this? Temperature. Sorry? Temperature gradient. The temperature? Gradient. The temperature, the non-uniform temperature right. Did you go and change the non-uniform temperature? Because I told you that you cannot touch the furnace otherwise the first thing that you would have told is, “Sir, let us go and fix the burner”. You cannot fix that I told you that you cannot touch that. So, irrespective of the variation in the input, I expect my tile which is my output variation should be very less. I say 1x1, but I will accept 0.98 to 1.2. I will accept that, sorry not 1.2, 1.02 I will accept. I cannot accept 0.8 and 1.2, I can accept 0.98 and 1.02. The variation in the input temperature, I have not addressed that at all it is still, with whatever solution that you gave and the one that I showed just now, the uniform temperature, the non-uniform temperature is still there I have not addressed that problem, but still I am getting an output of my tiles which are 1 by 1. That is the idea behind robustness. You should minimize the effect of the cause, you cannot touch the cause, we did not go and change the non uniform temperature, but what you have done is, what is the effect of the non-uniform temperature? It is, it created or it resulted in tiles that are of, that did not adhere to a 1x1 size. However, I have minimized the effect of the non uniform temperature which is the cause, without controlling the cause itself, in this case it will be the Kiln design. I have not touched that. This is the robust design principle. You have to live with the uncertainties or you have to live with the cause of the variation, but still you should be able to achieve your output, which in our case is a specified variation or within the specification and this is also sometimes called as parameter design or p-design. Usually if you see there will be a block, and they will have some factors that come into it. The factors are nothing but the parameter so, p stands for the parameter hence it is called the p-design. This is the underlying idea on robustness. Now what I am trying to show you is a small pictorial depiction of the Kiln example itself, ok. So, there are… the first one is this initial distribution here. You see this guy, what it means is there is a mean, ok, average that we are talking about, ok. So, this average that I am talking about is probably the 1 cross 1 that I am talking, ok, the area square meter or sorry square feet let us say, 1 by 1 square feet, ok. What I am saying is; if I were to draw this here let us say, this is your tile dimension. Okay, and then I am taking the first tile and then I am measuring what it was, it was this much, ok, it’s it’s somewhere here, and then I went to the second one it was here it was here, it was here and then what does the height of this one mean? It means there are multiple numbers at that level. So, if I did about 1000 tiles, ok. It is likely that this number of tiles might be about 500 or 600 in this level. And there might be some here like about 200, this might be about 200 this might be like that, ok and this is usually called the histogram, ok. It is basically a frequency plot. How many times or how many tiles out of the total tiles measured about 1 by 1. How many of them measured 0.8 by 1, how many of them measured 1.2 by 1, ok. Then you can kind of I mean it is not straightforward, but you can kind of come up with this, that is what we have plotted here, ok. So, what it means is there is a larger variation; I have not given you any dimensions here, the dimensions was just to motivate the example, ok. So, what it means is this ‘m’ is what your target is this is 1 by 1 for instance is what the ‘m’ is, this is what is the promised target but there was a deviation in the tile dimension before the solution. After implementing the solution, again, it is not that it is going to be a straight line still there will be variation, but the variation is… smaller. This is how you measure the variation. How thin or how fat that is not the correct word, but for us to discuss here to enable the discussion, ok, this distribution is thinner compared to this distribution which is fatter. A fatter distribution means; there is lot of deviation from what is promised or what is expected, ok. Whereas in this there is only a smaller deviation from what is expected, ok, which again means that there is more samples that is why this is a taller distribution when it is a thinner it is also a taller distribution, ok, but let us say that you have a magic machine, which lets you produce tiles of 1 by 1 dimension. How will this plot look like? It is just this straight line, ok, if you had thousand products it will be 1000 by 1000. It’s 1, that’s all. Otherwise I am saying there are about 800, in here there are about 800 tiles, where here there are about 100 tiles in this area and there are about 100 tiles in this area and there are about 10 tiles here and there are about 10 tiles here, ok. They will come as close as possible to your promise, but still there will be some variation. So, the requirement in any manufacturing or product, ok, so these are two different things when I say manufacturing is manufacturing of a product, but manufacturing ends by the time the user goes to the shop and gets it, until then is what the manufacturer has control, the dealer has control. After that it is the performance that is why I said either in manufacturing or product, when I say product it is performance when I say manufacturing when it is with the dealer. And this is also one of the subtle difference that people point out is until I sell it to you it is called quality. The moment you bought it from me it is going to be how well it performed to your expectations or to my promise then that is called reliability. How well it performs with you is called reliability and how well did I meet the specifications, ok, until I sold it to you is called quality. That is that is a small distinction that people make, it is a subtle distinction, ok. Okay, so, from… are you fine with this explanation? like, so, usually you can draw it from a histogram you can get these distributions if at all we are talking about that, ok. So, another part what becomes interesting is; when you want to measure the quality during design, ok. So, all this time we were only talking about the geometry or the manufacturing tolerance and all that right. So, that is what is given here in terms of parameter versus performance, ok. Now you need to talk about both performance as well as adhering to the specifications in terms of the geometric conditions, right? So, that is what is the parameter and then the performance is what the reliability that we talk about. And… what are all the parameters that you need to worry about, ok, in this one for instance in this particular example that we are talking about there might be other parameters also that will play a role. You can you can do further research to understand why there was a variation in this. Didn’t I make sure? like after 5 days after 10 days you might get a better understanding of the composition, and you might be able to drive it even further, ok, or let’s say that I relax one of the constraints like you can touch it you can touch the burners a little bit. Then you might be able to bring down the variation even better, ok. So, you need to understand what the parameters are which parameters play a role that becomes a very important stuff. And in order to do that you need to have efficient experiments this exp stands for experiments; to find a dependable information on the parameters. There are different ways or mathematical techniques or statistical techniques to do that, if you have a bunch of data today you can find out causal relationships, you can use something called the principal component analysis, support vector, singular value decompositions and things like that. These are all comes under something called factor analysis, they will tell you out of these factors, out of the 10 factors that you thought only these 2 factors are very important, then you can do the study representing only those 2 factors.
Info
Channel: NPTEL-NOC IITM
Views: 6,719
Rating: 4.9245281 out of 5
Keywords:
Id: Y83HAvLSfH4
Channel Id: undefined
Length: 30min 2sec (1802 seconds)
Published: Mon May 06 2019
Related Videos
Note
Please note that this website is currently a work in progress! Lots of interesting data and statistics to come.