Talk:Gittins index

Statistics Mid‑importance

	This article is within the scope of WikiProject Statistics, a collaborative effort to improve the coverage of statistics on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.StatisticsWikipedia:WikiProject StatisticsTemplate:WikiProject StatisticsStatistics articles
Mid	This article has been rated as Mid-importance on the importance scale.

Robotics Mid‑importance

	This article is within the scope of WikiProject Robotics, a collaborative effort to improve the coverage of Robotics on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.RoboticsWikipedia:WikiProject RoboticsTemplate:WikiProject RoboticsRobotics articles
Mid	This article has been rated as Mid-importance on the project's importance scale.

Mathematics Mid‑priority

	Mathematics portal This article is within the scope of WikiProject Mathematics, a collaborative effort to improve the coverage of mathematics on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.MathematicsWikipedia:WikiProject MathematicsTemplate:WikiProject Mathematicsmathematics articles
Mid	This article has been rated as Mid-priority on the project's priority scale.

Untitled[edit]

I don't think the discussion regarding the selection of technologies is relevant to the Gittins index itself. Investing in technologies is not really parallel to the N-armed bandit problem except at a superficial and probably artificial level. 165.125.144.16 (talk) 19:46, 11 September 2009 (UTC)[reply]

I think you are right, but this example appears often in relation with the Multi-armed bandit process. Indeed what one does in the selection of technologies is to gather information in a bayesian way and the states of the process are probability distributions, which are called belief state. There is an algorithm for computing the Gittins index in such a setup but it is quite complex and I agree that it would be just misleading in an introductory example. Pychron (talk) 00:42, 28 November 2009 (UTC)[reply]

Article's name[edit]

Shouldn't Gittins' have an apostrophe? Henriqueroscoe (talk) 14:48, 11 June 2010 (UTC)[reply]

Well, in the literature it does not, example Pychron (talk) 19:44, 18 June 2010 (UTC)[reply]

Editor Pychron is correct that the literature refers to the "Gittins index", just as mathematical literature referes to Hilbert space, Hardy space, Haar system, Haar measure (Hardy-Haar-Haar), Wald test, etc. Mathematical and scholarly practice differ from the recommendation of Strunk and White, who prescribe an apostrophe for forming the possessive for proper names (save Jesus and Moses). Cheers, Kiefer.Wolfowitz (talk) 10:20, 19 June 2010 (UTC)[reply]

Correct interpretation of Exploration vs Exploitation[edit]

The section "terminology" mentions a Bernoulli process with unknown probabilities. I would remove that reference: the basic Gittins index deals with processes whose probabilistic structure is known. The classical example of explotiation vs exploration refers to projects in which the course is unknown but the odds for every decision stage are known. Pychron (talk) 14:13, 12 August 2010 (UTC)[reply]

Citations[edit]

The references [7] and [8] are different papers on the same place. Jj14 (talk) 12:43, 9 February 2016 (UTC)[reply]

I don't get this, could you get more explicit? Pychron (talk) 13:25, 21 March 2016 (UTC)[reply]

ref 7,8,9:

Chen, Y.R. and Katehakis, M.N. (1986). "Linear programming for finite state multi-armed bandit problems", Math. Oper. Res., 11(1), 262–268

Kallenberg, L.C.M.(1986). "A Note on MN Katehakis' and Y.-R. Chen's Computation of the Gittins Index", Math. Oper. Res., 11(1), 262–268

Katehakis, M., Veinott, A. (1987). "The multi-armed bandit problem: decomposition and computation." Math. Oper. Res., 12(2), 262–268

Jj14 (talk) 23:41, 16 August 2016 (UTC)[reply]

Thank you, I have fixed it. Pychron (talk) 15:48, 3 November 2016 (UTC)[reply]