Question

Discuss the techniques that could be used for evaluation of R & D projects.

30 Oct 2017
Answer :
Word Count : 5918

An on-going research project aimed at analyzing the impact of R&D projects both from the public and private points of view. From the public perspective the social impacts and objectives of these projects, frequently supported by National or European R&D programmes, should be underlined and properly considered in the evaluation process. On the other hand, the private perspective emphasizes mainly financial and strategic returns for the companies involved in research projects. This paper addresses part of the research conducted so far, focusing in particular on the private perspective, namely on the identification of the more appropriate methods for the evaluation of research and development (R&D) investments projects by companies.

Several studies indicate that the use of traditional financial methods is not the most appropriate for evaluating R&D projects.The use of these methods consists, basically, on discounting the expected future cash flows and the adoption of several methods for measuring its financial viability (e.g. NPV, IRR). This implies that the costs and benefits associated with the investment are easily and objectively quantified. Nevertheless this is not always possible for all types of investments, particularly in the Advanced Manufacturing Technology (AMT), in Information and Communication Technologies (ICT), or in projects of R&D. For these type of investments, the estimation of financial flows and the assessment of their risks tend to be different from general tangible investments. This is particularly important in the calculation of benefits, which can be of three types: strategic, quantifiable and intangible. For example, the intangible benefits are difficult to quantify but may have a significant impact on return on investment.

Moreover, has been witnessing an increasing trend for companies to include non-financial dimensions/variables (e.g. strategy, flexibility and quality) of the problem in their decision-making process on investment projects. Indeed, these non-financial aspects are particularly important in the new industrial environment in which companies today operate, where new technological developments tend to occur more rapidly than the development of methods for the evaluation of investment projects.

Indeed, the evaluation of such projects, although often conducted purely in the perspective of business profitability, cannot be reduced to a simple analysis of discounted cash flows, since these projects often provide strategic gains that could hardly be translated into quantifiable monetary benefits in the short term. Moreover, there are also other factors that are difficult to measure/quantify, such as: political issues, environmental impacts, knowledge, intuition, or experience.

As a result, study discusses several non-financial criteria to be considered in the evaluation of R&D projects, which have been proposed in the literature related to products manufacturing, environmental, employment, users of the results of R&D, competitiveness of technology, relevance of technology, economic benefit, social benefit, quality of technical plan, availability of resource, technical risk, development risk, commercial risk, and return of investment.

A second objective is to conduct an inquiry to a sample of metallurgical companies in northern Portugal and southern Galicia in order to assess which practices have been used to evaluate R&D investments. In fact, this would allow us to gain an insight concerning both the financial and non-financial criteria used and if they use software support, as well as the importance of certain non-financial criteria in the evaluation of projects. Moreover we are trying to see if they currently use any of the multi-criteria methods.

The ultimate goal of this research would be to propose an integrated methodology that can be applied to the evaluation of R&D projects, based on financial and non-financial methods using multi-criteria techniques. The purpose of multi-criteria models is to break a complex problem into simpler parts. That allows the decision-maker to structure a problem with many criteria in a visual way, through the construction of a hierarchical model that basically contains three levels: aim or objective, criteria and alternatives. Once the model is built, two by two comparisons are made between these elements (criteria-subcriteria and alternatives) and numerical values are given to the preferences assigned by individuals, therefore obtaining a summary value by aggregating this partial judgements.

In the evaluation of R&D investment projects, the use of traditional financial methods only is not the most appropriate procedure. In fact, companies are moving in turbulent environments that directly affect them and there is an enormous competition among companies. Therefore, these need more suitable methods to assess the value of R&D investments.

Financial criteria: Over the years companies have generally based the assessment of their projects on financial criteria in order to achieve the best economic performance. This is why the academic community has proposed several methods that can help to improve capital investment decisions of companies. These investment evaluation criteria are indicators that help to determine whether a project should be or not undertaken, allowing important decisions of the project to be optimized, such as location, technology, optimal time to invest in or abandon a particular project.

Financial convenience to undertake an investment project can be analyzed in principle, according to their economic performance or expected profitability, that is, if the net cash flows generated during their lifetime (revenues minus costs and expenses) outweigh the initial investment.

The translation of the economic realities to algebraic equations is always a delicate approach, and it is odd that a mathematical formulation, as thorough and deep as it may be, may reflect the complexity and the highly uncertain nature of the problems of the economy world.

Below a brief summary of the main financial methods is given, distinguishing between those that do not take into account the time value of money from those which do. The first group includes the payback period (PBP) and the accounting average rate of return (ARR).

The payback period (PBP) calculates the number of years needed to recover the initial investment. Its interest lies only in the recovery time of this invested amount, hence its decision criterion is based on choosing the project that recovers the initial investment in a shorter period of time. Therefore, this method rewards liquidity over profitability. Thus, the money invested will soon be recovered and one will have a lower risk investment (Mascareñas, 2008). In times of high volatility the use of this method is a way to increase the security of investments since the time it would take to recover the investment would be known. In addition this method is easily understood and very simple to be implemented. However, as this method is only interested in the time period in which the initial investment is recovered, it disregards the cash flows generated after the recovery period. Another drawback of this method is the fact that it does not consider the time value of money. This problem can be easily overcome using discounted cash flows (Vela, 2005). Finally, this method tends to accept more projects with a shorter live over more profitable projects but with a longer period of time to recover the initial investment.

The accounting average rate of return (ARR) method, relates the average annual cash flow and the initial investment showing an average rate of return of the project (Fernández, 2007). This is an easy method to understand and to apply as the values used are the ones directly obtainable from accounting data, and it is also easy to obtain a term of comparison.

However this method presents some problems: First, it ignores the time value of money. Secondly, it is based on accounting profits and not on the project cash flows. Furthermore, it is necessary to set a standard reference for assessing a project.

In the second group of methods (discounting cash flow methods) one can distinguish between the net present value (NPV), the internal rate of return (IRR) and the profitability index (PI). The NPV consists of discounting all the expected future cash flows of an investment project, using a discount rate which is the opportunity cost of the capital employed in the investment project. After discounting all the future cash flows the

value of the initial investment is subtracted, hence the name of Net Present Value (Mascareñas, 2008). This method by discounting the expected future values of cash flows, eliminates the disadvantages of the two former methods in relation to the time value of money, but its calculation requires time, the understanding of this concept and also a discount rate for calculations (García, 2007)

The discount rate applicable is the cost of capital or minimum acceptable rate of return, which includes the loss of purchasing power of money, the risk-free interest rate and the risk premium (Baca, 1996). The cash flows should consider all payments and receipts for a certain project over its lifetime.

The NPV has some drawbacks. It is unable to properly assess investment projects that are flexible with time, i.e. that incorporate real options (growth, abandonment, postponement, learning, etc.), which implies that the value obtained through the simple discounted cash flows underestimate the true value of the project. Another drawback is that in the computation of the NPV it is implicitly assumed that the cash flows, which are generated over its lifetime, will have to be reinvested until its term at a rate identical to their opportunity cost of capital

Usually, as the investor does not know the reinvestment rate he will have no choice but to calculate the NPV, but knowing that at the time of the reinvestment of cash flows the interest rates could be above or below the initial cost of capital used, which could lead to a different result from the one calculated at the time of elaborating the investment project. Moreover, this method implies to determine the discount rate previously .

There is a variant of the NPV method: the profitability index, which consists of dividing the present value of cash flows by the initial disbursement of the investment (Mascareñas, 2008). This method is applied in situations where there are capital restrictions. At first, those investments whose rate of return exceeds the unit would be undertaken, since this fact would indicate that the amount recovered from the investment, taking into account the effect of time on the value of capital, is higher than the one paid. The main limitation of this method is that it does not yield a period return but throughout the time horizon of investment, which complicates their understanding.

The internal rate of return (IRR) represents the discount rate for which the NPV of the project is zero. Implicitly it assumes that cash flows are reinvested at the same IRR until the end of their life in the same project or other projects with the same performance (García Dumrauf, 2003). Besides the capital growth is expressed in relative terms, and the growth rate of capital is determined per period.

This is a widely used criterion for project evaluation because it can be compared to the opportunity cost of capital. However, when using the IRR the following problems can be highlighted. Firstly, the problem of multiple IRR, when there are positive cash flows mixed with negative ones. Secondly, in the case of mutually exclusive projects, NPV and IRR can lead to different conclusions about what project should be accepted.

Finally, in calculating the IRR it is implicit the assumption that the cash flows being generated by the project during its economic life are reinvested at the IRR. However, this seems to be an unrealistic hypothesis,

especially when high values are obtained for the IRR.

It is noteworthy that there is a variant of the IRR called IRRM. This method of valuation takes into account that the reinvestment of cash flows generated by the project will have to be at the opportunity cost of capital, and therefore it always provides a unique positive rate of return which is very useful for the completion of the projects.

Several authors, (e.g. Peumans, 1974, Weston and Brigham, 1984, Brealey and Myers, 1998 and Belli,

1996) argue about the difficulty of applying the criterion of the IRR due to the lack of good properties of this indicator of desirability of a project. Thus, Gronchi (1986) states that the internal rate of return can be used in decision-making procedures only if it is unique. Given these difficulties, one can opt to dispense the IRR and use the NPV, which is Oehmke’s main conclusion (2000) and Castelo’s starting point (2001): If the researcher is very sure of the appropriate discount rate to use, then there is no problem: either the NPV is positive in that type or not. For Ross (1995), the IRR is not a good decision criterion at all, because it does not lead to the same decision as the NPV. The problem might also be simply ignored examining only the case of the unique IRR.

Non-financial criteria: During recent decades, the globalization of financial markets, the intensifying competition among companies, financial institutions and organizations, as well as the rapid economic and social development, and technological changes have led to growing uncertainty and instability in the financial situation and business environments (Zopounidis and Doumpos 2002). Simultaneously, in order to achieve higher profits and to maximise the value of the company, managers seek a differentiation with the rest of their competitors, which implies, in some cases, to invest in R&D projects.

Steuer and Na (2003) argue that a modern enterprise is a complex organization in which different interests interact one another, each one with its own idea on the maximization of wealth, subject to concerns

about risk, liquidity, corporate social responsibility, environmental protection, welfare of employees, and so on. That is why it may be desirable to apply a multiple objective approach to many decision-making criteria. That is why the decisions should be made taking into account not only economic aspects, given that not all factors that change with an intervention are quantitatively expressed in a traditional or monetary way. The political consequences, their environmental impact, some after-effects to the project, the achievement of strategic objectives, the contribution to decentralization, the investment risk, the term return, among others, are factors difficult to quantify and can have a major impact on projects. From the design to the completion of a project throughout the process, factors such as perception, intuition, experience and others, are of vita l importance, therefore, the human-qualitative factor cannot be excluded.

According to Henig and Katz (1996), the evaluation of R&D projects is difficult using

________ __________ ______ ____ __________ ___ _______ ___ _______ _________ ___.
________ _____ _______ __________ ___ _______ ______ _____ __________ _______.
___ ____ ___ ________ _______ _________ ________ ____ ________ ____ _________.
______ ______ __________ ________ _______ _____ ________ ______ _________ ___ ______ ___.
_______ _________ ________ ____ ____ ___ ______ ______ ______ ___.
______ ___ ___ ______ _____ __________ ___ ___.
__________ _________ ____ _______ ___ ____ ___ ____.
____ ______ _______ _____ _______ ____ ___ __________ ______ _____.
__________ ______ _______ ______ _____ ___ _______ __________ __________.
_____ ______ ______ ______ ______ _________ __________ ______ __________ _______ ________.
_____ _________ _________ ______ _______ _________ ___.
___ ______ ______ _____ ____ ___ ___ ____ _____.
_____ _____ _____ ________ ___.
___ __________ ____ ________ _______ _____ __________.
____ ________ ____ _____ ________ __________ _________ ________ ________.
________ ___ _______ ___ _________ ____ ________ ____.
_______ ___ ___ ___ _____ _________ _______.
_________ ___ _____ _________ ___ _____ ___ ________ _____.
________ ___ ______ ______ _____ ___ _______ ______ ____ _________ ___ _______.
_____ _________ _____ ___ ________ ____ _________ ___ ____ ___ __________ ____.
___ ____ ________ ___ _______ _____ _________.
___ ______ ________ _________ ________ __________ _____ _______ _____.
_____ __________ _________ ___ ____ ___ ___ __________ ________ _______ _______.
_______ _________ _______ ___ __________ ______ _______ _______ _______.
______ ___ ____ _____ ____ ____ _______ ______ _____ ________.
________ ___ ___ _____ _____ _______ _____.
_________ _______ _________ _____ ____ ____ __________ _____ _____ _____ ____ _________.
_____ ____ ________ __________ ________ ____ ___ _____ __________ _____.
______ ______ ____ ______ ________.
______ ______ __________ ______ ____ _____ _________ ______ ____ __________ ______ ________.
______ _______ __________ ______ _______ ____ _________ ______ ____ _____ ___ ____.
___ _____ _____ ________ _____ ____ ___ __________ ___ ________ _________.
_______ ______ _______ _________ ______ __________.
__________ _________ _________ ___ _________ ______ ____ _______.
____ _________ ______ __________ __________ ___ _____ _________ ________ ________ _____.
______ ______ _____ _______ ___ ____ ______ ___ ________ ___.
___ ____ _____ ____ ____ ____ ____ ______ ___ _____.
________ ______ _____ ___ _____.
__________ _____ _______ ____ ________ ___ _______ ______.
_________ ___ _________ _____ _________ ___ __________ ____ ______ _______.
____ _______ ____ ______ __________ _______ ____ ___ _______ _________.
_______ _____ ________ ______ _______ _____.
_________ __________ ___ ___ _____ ___ ______.
______ __________ _______ ______ __________ _______ ____ ___ ________ ___ _____ _______.
_____ _______ ____ _____ ________.
________ ________ _________ ____ ____ ______ _________ _____ _____ _______ ________.
______ ________ _____ ____ _________ ______ ________ ________ ______ ___.
____ ________ ___ _______ _____ _________ _________ _____ ________ ______.
__________ ___ ____ ____ ____ ________ __________ _____ ______.
________ _______ ______ __________ _____ _________.
____ ________ ___ _________ _________ ____ ________ _________ ___ ____ _____ _________.
_________ ________ ________ ______ _________ ___ __________ _______ _________.
_______ __________ _______ ______ _______ ____ _________ _____ ______ _________ _____ ___.
_______ _______ ___ ______ ____ _______ _____ _____ ______ ____.
_______ ____ ____ ___ ____ _______.
____ ____ ________ __________ __________ _____ _________ ______ ________ ___ _________.
___ _________ _____ ______ __________ _____ __________ ___ __________ _____ ___.
______ _____ _______ ________ _________ _________ _____ ________ ____.
___ _________ _____ ________ ______ _________ _______.
____ _________ _____ ___ ________ ______ _______ ____ ______ _____.
______ ________ ______ _________ __________ __________ ___.
____ ___ _______ ___ _________.
____ __________ ____ ________ ______ ____ _________ ______.
__________ _________ _________ __________ __________ ____ _________ ____ ___.
_____ ________ ______ ________ ___ ________ ____ ____ __________ ____ _____.
______ __________ ________ ______ ________.
_______ __________ _____ _______ _____ _________ ____ _________ __________ _____ _________.
_____ _________ _________ ________ __________ _________ ____ ________ ________ _________ _____ ____.
_______ ______ __________ __________ _______ ___ _______ _______.
___ ___ _______ _______ _________ _____ _________.
_______ __________ _______ _________ _______ __________ ____ _____ ________.
________ _________ ________ _______ ___ ______ _____.
____ ______ ____ ____ ________ __________ _________ _____ ________.
___ _____ ____ _____ ___ ____ __________ ____ ______ _______ __________.
__________ _____ _________ _______ ______ ____ ________ ______ _____ ____.
________ ______ _________ ________ __________ ________ ________ ____.
_________ ________ ____ ______ _________ ______ __________ _______.
______ _________ ________ __________ _____ __________.
____ ______ ____ ___ _____ _________ ____ ___.
_____ ________ _______ _______ _________ ___.
____ ____ _________ _______ _____ ______ _________ _______ __________.
_______ _________ ________ ____ ____.
________ _________ ________ _______ ___ _____.
_____ ________ _____ ____ _______ ________.
__________ ____ ___ __________ _________ ____ ______ ___ ______ ______.
__________ _________ _______ ___ __________ __________ _____ ___ _____ __________ ______.
_____ ___ ______ __________ _________ _________ _____ ___ ________.
______ ______ _____ ___ __________ ______ ____ ________.
___ _________ _________ ___ _________ ___ ______ ___ _________ ___ ________ __________.
_____ ______ ___ ________ ________.
______ ________ ______ __________ ________ ____ _______ ____.
_________ ____ _______ __________ _________ ______ ________ ______ ____ __________ __________.
_________ ________ _________ ________ __________ ____ _________ _______ ____ _____ ________ _________.
_____ ____ ___ ___ ___ ______ _________ _______ _______ ______ _________.
___ _____ ___ _________ __________.
___ _____ _________ ____ __________ _____.
_______ _____ _________ ____ _______ _______ ____ __________ ______ ___.
____ _______ _______ _______ __________ ________ _____ ____ _____ ________ ____.
____ ________ _____ _____ ___ _____.
_______ ____ _____ ____ __________ ____ _______ _____ _________ ______ _______ ____.
__________ _____ ___ ___ __________ ______ _________ _________ __________.
________ ____ _________ _____ _______ ______ ____ ______ __________.
____ __________ ________ ____ _______ ________ ______ _____ ________ _____ ______.
______ ____ ____ ____ ____ ____ __________ _________.
__________ _________ ______ ___ _________ _____ ________ _____ ________.
__________ ______ ________ ____ _________.
_______ _____ ____ ________ ____ ____ _______ ______ __________ _______ ______ ____.
___ ________ ________ __________ __________ ________ ______ _________.
________ ____ __________ ___ ________.
_____ _______ ___ _______ _________.
_________ _________ _____ ______ __________ _______.
__________ _________ _________ _____ __________ ____ _____ __________ _______ _________ __________.
______ ________ ______ _____ ____ ___.
____ ______ _____ __________ ______ _______ _____ ____ _________ ________.
_________ _____ __________ _____ _________ ________ ______ ___ ______.
_________ __________ _______ ______ ______ _______ _________ _______ _________ __________ __________ ___.
__________ _________ _____ _____ _____ __________ ____ ________ ________ __________.
_____ ________ ___ ______ ____ ________ ________ ____.
_______ ___ _________ ________ ________ ________ ___ _________ ______ __________ __________ _______.
_________ __________ ____ ____ _____ _______ ________ _________ ________ _______ _____.
____ ______ _____ ____ ___ _______ ____ ______ _____.
_____ ________ ____ ________ _________ ___ _________ ______ _________ _____.
______ _________ _________ ________ ___ __________ __________.
_______ ______ ______ _______ _______ _________.
____ ___ __________ _____ _________ ____ __________ _____ ______ ________ ____ ________.
_______ ____ ___ ___ ___ _________ ______ _________ ___ _______ ________ __________.
_________ ________ ________ ___ ________ _________ ____ _______ __________ __________ _______ ______.
__________ ________ ________ _________ ________ _____ _____ ___ ___.
_____ __________ ____ ________ _____ _________ ___ __________ __________ ________.
___ _______ ____ _________ ___ _______ _____.
___ _______ ___ _______ ________ _________ __________ _______ _______ __________.
____ ________ _______ __________ ______ ___ ________ ____.
__________ __________ _________ __________ ___.
_________ _____ _____ ________ ___ __________ _____ ____ ________ _____ _________ _________.
______ ________ _______ _________ ____ __________.
_____ ____ _______ _____ ______ _______ _______ _______ _______.
_______ _______ _________ ____ ________ ________ ________ ______ ________ _______ ________ _______.
______ ______ ______ ___ ______.
______ __________ _______ _________ ____ ________ ___ _________ _________.
______ ________ _________ ____ __________ __________ ________ _____ ______.
__________ ______ __________ _____ ___ _________ ________ __________ ________ ________ __________.
___ ____ ___ ____ _________ ___ ___ _______ ___ ______.
_______ ________ ___ ______ ____ _____ ___ __________ _____ _____ ________.
_______ _______ _________ __________ ____ ___ __________.
_____ _____ _________ ______ __________ _________ ________ ____ _______ ____ _______ ___.
__________ _________ __________ __________ _____ ______ _____ _____ _________ ________ ____ ___.
_________ ___ ____ ______ ____ _____ ____.
_________ ______ ______ ______ ____ ____ _____ ________.
_________ _____ _____ _____ _________ _____ ______ ___.
______ ____ ___ ____ ____ _______ _______ ________.
_________ ________ ________ _________ _____ _____.
________ _______ __________ _______ ____ ___ ____ ___ _________ _________ __________.
_______ _____ _______ _________ __________ __________ ______ ________.
_______ _________ _______ ______ ________.
__________ ____ ____ ___ ________ _______ ___.
____ _____ ___ _____ ___ _____ __________ ____ _________.
_________ ____ _______ ______ ________ _______ ________.
__________ ____ ___ ____ _________ _________ ______ ________ _________.
________ _________ ____ __________ _______.
_____ _____ _________ ________ _______ ________.
_________ ___ ____ ____ __________ ________ _____ ___.
_________ ____ _____ _____ _______ ____ _____ _________.
_____ _____ ____ ___ _________ __________ ____.
____ _________ _______ ______ ____ ________ _______ __________ ________ ______ _______ _______.
__________ _____ ____ ____ _____ ____ _____ _______ __________.
_________ ___ ____ ______ ________ _____ _____ ____ _____ ______ ____ _______.
____ _________ _____ _______ ______ ______ ____ __________ ______ _________.
________ _________ ____ __________ ________ ________.
________ ________ _________ ____ ___ ____ ___ ______ ________ ____ ________ _______.
___ _______ ________ _________ __________.
__________ ___ ____ ___ ______ _____ _________ ___.
_______ ____ _________ ______ ___ ___ ____ ________.
____ ___ _________ ____ ___ ___ ______ ______ ________ ___ ________ _____.
______ _________ ______ __________ ________.
________ _____ _________ _____ ________ _________ ______ _______ ____ __________.
_______ _____ _________ ________ ________ ____ ______ _______ __________.
__________ _______ ___ _______ _______ __________ _________ ____ ______ ________ ________.
_______ ____ _____ ______ _____ _______ ___ _____ _______ ________ ____ _____.
__________ ____ ____ ___ _________ _________ ________ ______ __________ _____.
_________ ___ _____ _____ __________ ______ ________ ___.
_____ ____ ________ ____ ______ ______ ____ _______ ________ _______ ______.
________ ________ ________ ____ ___ ____ _______ ___ _______ _______ _____.
_______ _______ _____ ________ _________ ___ ______.
__________ ___ _________ ______ __________ _________ _________.
______ ________ ____ _______ _____ _________.
_________ ______ ________ _________ _________ ____ ________ _____ ___ ___.
______ ___ _____ __________ ________.
____ __________ _______ ________ ___ _____ _________ ______.
_____ ________ _________ _________ ____ _________ _______ ________ _____ __________ _____.
_________ _________ ______ ______ _____ _______.
______ _________ ______ _________ __________ __________.
_______ _______ _________ _____ _____ ______ ___ ____.
__________ _____ ___ ____ ______ ________ _______ ____ _________.
__________ __________ ________ _____ ________.
___ _______ ____ ________ _______ _____ ______ _______ ____ _____ _______ ___.
___ _____ _____ ______ ______ ____.
________ _________ _____ ______ ________ ______ ________.
______ _______ _____ __________ ___ __________ ______ _________ ______ ___ __________ _______.
_____ _______ ___ ________ ____ ______ ________ ___ ________ __________ __________.
_____ _______ ___ _____ __________ ___ _______ ____ ____.
______ ________ _________ ________ __________ __________ ____ ____.
___ _________ _____ __________ ____.
_________ ________ ___ _____ _____ ____ ______ ______ _______ _______.
_______ ______ _____ ____ ___ _________ _____ _______ __________ ____.
______ ____ ______ ___ __________ ______ __________ _______ _______ ___.
______ ___ __________ __________ _____.
________ ___ ___ _________ _____ __________ _______ __________.
____ ________ _________ ____ ____ _________ ___ _________.
_______ ____ __________ ________ __________ ___ _______.
______ ______ _________ _________ __________ _______.
_______ ___ ___ ____ ____ _____.
____ __________ _______ _______ ___ _______ _____ _______ _____.
___ ____ _________ _______ ________ _______.
__________ ________ __________ _________ ___ _______ _____ ________ ____ ___ ___.
__________ __________ ________ ______ ____ _________ __________ __________ ____ __________ __________.
______ _______ _______ _____ ____ ______ ___ _______ _____.
____ _______ _______ __________ ____ ____ ________ __________ ________ __________ ______ __________.
___ ____ ____ ________ _________ _______ ___ __________ ____ ________.
______ ________ ________ __________ ____ __________ ____.
____ ___ ______ ___ ________ __________.
____ ______ ___ _________ __________ ________ ________ ___ _______.
__________ ____ _____ ________ ______.
___ ________ ____ ________ __________ _______ _________ ___ ___.
________ ______ _________ _____ ____ _______.
________ __________ _______ ______ ___ ____ ___.
______ ______ ________ _______ ______ ____ _____ _________ __________.
______ ______ _________ _____ _____ ___ ____ ________ _____ ____.
________ __________ ______ ________ _______ _____ _____ _______ __________ __________ _________.
__________ ________ _____ _____ __________ __________ ____.
______ _______ ________ ______ ____ ____.
_________ ________ __________ ____ __________.
_____ __________ ______ ___ ________ _______ _____ _____ _______.
__________ _________ ______ ____ ______ ___ ______ _________ ___ ___.
______ ___ ____ ______ ________ _____ _______ ____.
______ ____ __________ ________ _______.
______ ________ _________ _______ ________ _____ _________ _______ ____ _____.
_________ ______ ________ ____ ______ ______ ____ _________ ________ _________ _____ ________.
________ _____ _____ _________ _______ _____ _______ ________.
_______ __________ __________ _______ _____ __________ ______ ____ ___.
____ ____ ________ ____ ____ ______ ___ _____ _______ _________ ____.
______ ____ ________ ____ __________ ______ _____ ___ ______ ______ _______ _________.
___ ______ ________ __________ ___.
______ ________ __________ ________ ______ ______ ______ ____ ______ ___ _____.
______ _______ ____ ________ __________ ________ _________ _______ ___.
________ _____ __________ _______ ______ _________ ____ ____ ______ ___ _______.
___ _______ ________ ______ _________ ____ _______ __________ _________.
________ ____ ______ _______ ________ _______ _____ ______.
_____ ________ _________ _______ ______ __________ _____ ______ _______ ________ _________ ____.
_________ __________ __________ ________ ____ __________ ________ _________ _______ _________.
________ _________ ____ _________ _____ ________ _____.
_____ _____ ________ ________ __________ ______ _________.
_________ __________ _________ _______ _____ ________ ____ _________ _______ ____.
_______ _____ _____ __________ ______ ________ ___ ___ ________ ____ ______ __________.
_________ ___ _____ ___ _____ ____ _______ ____.
__________ __________ _____ _______ ________ ____.
__________ ______ _________ ____ ____ _________ _________ ________ _____ ____ _____ ______.
____ ____ __________ ____ _________ ____ _________ __________ ________.
____ _________ _________ _______ _____ _______ _______.
________ _______ ________ ___ _____ ______ ___.
_________ ________ _____ ___ ______ _______ ____ ___ ___.
_______ _____ ____ ______ ____ _________ _________ _____ ___ __________ ________.
_________ __________ ___ ______ _________ ___ ________ _______ ___ ___ ____ ___.
___ ________ _____ ______ _______ _____ _________ ____ _________.
______ _____ ____ ________ ____ ______ _____ _______ ________ __________ ___.
________ _________ __________ ______ ________ ________ __________.
_________ _____ ________ ________ _________ ____.
_________ ______ ____ __________ ________ ______.
_________ ____ ________ _______ ___ __________ ____ _____ _____ ____ ____.
_____ __________ _______ __________ _________ ___ _____ _____ ______.
_________ __________ ____ ______ ______ _______.
_______ ___ __________ ___ ________ __________ __________.
___ __________ _____ ______ _______ _____ ____ _____ ________ _________.
__________ _________ ________ ______ __________ _______ __________ _____ __________ ________ ____.
______ _____ _____ ________ _________ __________ ___ ___ _____ ________ _________.
__________ _______ ____ __________ _____ ______ ________.
____ ____ ______ _________ ___ ________.
_____ _____ ______ ____ ______ _________.
________ __________ __________ _______ ___ ___.
____ ________ _______ ___ __________ _______ _______ _________.
______ ________ _______ ______ ________ ________ __________ ______ ___ ___ _____.
________ _________ _____ _______ _________ _____ __________.
_____ _____ ___ _________ ____ _______ _________ _________ _____ _________ ______.
__________ ______ _______ ______ ___ ________ ________ ____ ________ ___ __________.
________ _______ __________ ____ ________ _______ ______ _____ ________ _______.
___ _____ _________ ______ ____.
____ ______ _______ ______ _____ _____.
____ _____ ______ ____ ___ _____ ____ _________ __________ _______ __________ ___.
_______ ______ ______ _________ ___ _______ ________ ___ ______ __________.
_______ _______ ______ _________ ___ ________ ____ ____ ________ ______ _____.
_____ __________ ___ ______ ______ ___ _________ _______ __________ _____ _________ ________.
_________ _____ ____ __________ ______ _______ ____ _______.
_______ __________ ______ ___ _______ _______ _______ ____ ________ _____ __________ _____.
________ ____ _______ ______ _________ __________ _____ _________.
_________ __________ ________ ______ ________ ______ _________ ________ __________.
__________ _________ _________ ____ ________ _____ ________ ________ _____ _____ _________.
________ _______ ______ ______ _____ ____ _______ _______ _____.
______ _____ _________ ____ _________ ______ _____.
______ ____ __________ ____ ________ ____ ___ ___ _______ ______.
____ _________ ___ _________ __________ __________ __________ ___ _________ _______ ___ _____.
_____ _____ __________ __________ ______ ___ _________ ______ _________ _________ __________ __________.
____ __________ ________ _____ _____ ___ _______ ________ _________ __________ ______ _________.
_____ ______ ______ ____ __________ _____ ___ ________ _________ __________ ___.
____ _______ ________ ________ ________ __________.
_________ ___ _____ ________ _____ ____ ______ __________ _________ _________ ____.
_______ ______ _____ _____ _________ _________ _________ ___ _____ ___ ____ _______.
_______ __________ _____ _______ ______ ____.
____ ________ ___ ________ ___ ____ __________ _______ ________ _________ _______.
___ ___ ___ ______ ____ __________ ______ ____ ________ ____ __________.
____ ____ ______ _______ ____.
__________ ___ _________ __________ ______ ____.
__________ __________ ________ _____ ______ _______ ________.
__________ ______ ________ _________ ___ ________ ___ __________ __________.
________ ______ __________ ___ ___ __________ ___ _______.
_____ __________ ___ _____ _____ ___ ________ _________ ___ __________ _______ ____.
__________ _____ ___ ______ ________ _________ ___ _________ _______ _____ _______ _______.
____ ________ _____ _________ _____ ___ _______ ____ ___ _______ _________ ______.
___ __________ ________ ______ ____ ______ _________.
___ ___ ___ ____ __________ ______.
____ _________ _________ _______ ______ ________.
________ ___ _____ ___ _________ ________ ________ _____ ____ ______ __________.
________ _________ ___ ___ _______ _____ _____ __________ _______.
___ ___ ____ ____ _______ ____ __________ ________ _____ ___ __________ ________.
________ _______ _______ ____ ___ __________ ________ _______ _____ ______ _______.
___ _________ _____ ______ ___.
_______ ___ ______ _______ ____ _________ _______ ____ _____ ______ __________.
_____ ______ _____ _________ _______ _________ _______ _________ ____ _____ ___ ____.
_________ _________ ____ ___ _________ ______ _______ ___ __________.
_______ ________ ____ ___ __________.
_______ ________ ______ ________ ______ _________ _______ ______ ______.
________ __________ _________ __________ ___ ____ ______ _________ ___ ________ ________ ______.
______ ________ ______ _______ _______ ___ ________ ___ _____ _______ _______ ________.
________ _____ ________ _________ __________ _______ ________.
__________ _____ _________ _________ ___ _________ ________ _________ ___.
___ _______ _____ ___ ____.
______ _____ ______ ________ ___ _________ ____ _____ _____.
__________ ________ ________ ___ _______.
_______ __________ _________ ______ ________ ________ _____ _________ _______ _________ __________ ___.
_______ ________ ________ ______ _______ _________.
_____ _________ _____ _________ ___.
____ _______ __________ _____ _____ _________ __________ _______ _______.
______ ________ _____ _________ _______ ___ __________ ________ ________ ___ __________.
________ ______ ______ ________ ________ __________.
______ ________ ________ ___ __________.
________ ______ __________ ___ _____.
_____ ______ __________ _______ ______ _______ _______ ________ ______.
____ ___ __________ __________ __________ ______ __________ ______ _____.
__________ ___ ________ _____ ______ __________ _________ __________ ____ _______ _________ ___.
____ _____ _____ _____ _____.
_________ ____ ______ _______ _____ _______.
_______ _______ _______ ____ _________ ________.
_________ _____ ___ _______ ____ __________ ________ ___ ____ _________.
_____ ________ _________ ______ ________ ________ ___ ______ ____.
______ ____ ____ __________ _________ _____ ___ ____ ___ __________ ____.
_______ ____ _________ ________ _____.
______ ____ ________ __________ ______ ______ ______ _________ _________ _____.
____ _____ ___ __________ _________ _________ ______ ________ _______ ______ __________ ______.
____ __________ _____ _____ ____ ___ _________ ____ __________ ___ _______ _________.
_________ _____ ______ ______ _______ _________ ______.
_________ ______ ___ __________ _________ ______ ________ __________.
__________ ________ _____ ____ ____ ______ ____ _____ ___ _____.
_____ ______ _________ ______ _________ _______ ____.
_______ ______ ________ ____ ____ __________ _____ __________ ______ ___ ___.
________ ________ ________ ________ _________.
________ __________ ______ __________ _______ ______ __________ ________ _____ ______ __________ __________.
_____ ____ _____ ________ _______ ____ _________ __________ __________ _______.
______ ______ ________ _____ _____ ____ __________ ___ _________ ______.
_________ ___ ______ _______ _________ ____ ____ _______ _____ ______ __________.
______ ___ _____ __________ _________ ______ ___ _______ ___.
________ ________ ______ ____ ________ _______ _____ __________ _____ ______.
___ _____ ________ _____ _____ ________ _______ ___.
______ _________ ________ _______ _____ ___ ___ ______ ______ ________ ___.
_____ _______ _____ _____ ___ ________ _________ __________.
___ _______ __________ ___ _______.
__________ __________ _______ _________ ________ _______ ________ ________ __________ ______ ____.
____ _____ _________ ________ ___ _________ __________ ______ ______ _____.
______ __________ _______ ____ _______ ________ ______ _______ _____ ______ ________ _______.
________ ________ ____ __________ _________ _________ ____ ___ _______ ____ ______ ________.
_____ ____ _________ ____ ________ ________ ______ _______ ____.
___ ________ ____ _______ ____ _____.
_______ ___ _________ ______ _______ ______ ______ ___ __________ ___ ____ ____.
_____ __________ ______ ___ ____.
____ _______ _________ _________ _____ ____ ____ ___ _____.
______ ___ __________ ____ __________ ____.
__________ ____ ___ _______ __________ ___ _______ __________ ___ ______ _______.
______ _______ _______ ___ ________ _________ ___.
__________ ______ ____ ____ ___ __________ ___ _________ _____.
_______ ________ _________ _____ _______ _________ ________ _________ ____.
___ ________ ________ _________ ________.
__________ ______ _____ _____ _____ ___ ________ ____.
______ ____ __________ _______ ___ _______ _________ __________ __________ _______ _________ ____.
___ ____ __________ ________ _________ ____ ____ _________ __________.
___ _____ ______ ______ _______ _________ ________ ____ ____.
_________ ______ _______ _________ ____ __________ _______ ________ _____ ____.
_______ _______ ______ _____ ______ _________ ____ _________ ___ _________ _______ ____.
__________ ___ __________ ____ __________ _______ _____ _______ ___ ________ _______.
___ _______ ____ ____ _________ __________ _____ _______ _________ ______ __________.
________ ________ __________ ____ _________ __________ _________ ____ ______ _________ ____.
___ ________ _______ _________ ____ _____ _________.
____ _____ ______ _____ ______ ________ ___ _____.
____ ____ ________ ________ _______.
_________ ________ ______ ________ _________ _________ _______ ____ ________ __________ ____.
_______ ______ _________ __________ _______ ________ ____ ________ _______.
________ ___ ________ ___ _____.
_________ __________ ___ _________ _________.
IGNOU ACADEMY
Your IGNOU journey, made easier.
  • Solved Assignments
  • Study Notes
  • Guess Papers
  • Question Papers
Skip in 10
Top
📞
Call Support Instant phone assistance IGNOU MS 58 2011 - Discuss the techniques that could be used for evaluation of R & D | IGNOU Academy
→
🟢
WhatsApp Chat Fast live messaging
→
Email Us Business enquiries & support
→