Cannot stop XMLEventReader thread with Thread.sleep present (or v large file)

[fancellu]

https://gist.github.com/fancellu/780d7c3dab1a8309f561

I'm trying to pull in some XML events, and stop after a few.

Blocks on ProducerConsumerIterator.produce

If I take out the Thread.sleep, it works fine.

Any idea why? Is this a known "feature" ?

Also, on a big (4GB) xml file, er.stop doesn't even stop it, seems to run to end of file

This isn't really what I want out of streaming.

Any help would be appreciated.

Thanks.

[ScalaWilliamD]

Also

er.close()
src.close()

gives

Exception in thread "XMLEventReader" java.io.IOException: Stream Closed
    at java.io.FileInputStream.readBytes(Native Method)
    at java.io.FileInputStream.read(FileInputStream.java:272)
    at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:283)
    at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:325)
    at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177)
    at java.io.InputStreamReader.read(InputStreamReader.java:184)
    at java.io.BufferedReader.fill(BufferedReader.java:154)
    at java.io.BufferedReader.read(BufferedReader.java:175)
    at scala.io.BufferedSource$$anonfun$iter$1$$anonfun$apply$mcI$sp$1.apply$mcI$sp(BufferedSource.scala:38)
    at scala.io.Codec.wrap(Codec.scala:68)
    at scala.io.BufferedSource$$anonfun$iter$1.apply(BufferedSource.scala:38)
    at scala.io.BufferedSource$$anonfun$iter$1.apply(BufferedSource.scala:38)
    at scala.collection.Iterator$$anon$9.next(Iterator.scala:162)
    at scala.collection.Iterator$$anon$17.hasNext(Iterator.scala:511)
    at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
    at scala.io.Source.hasNext(Source.scala:226)
    at scala.xml.parsing.MarkupParser$class.ch(MarkupParser.scala:104)
    at scala.xml.pull.XMLEventReader$Parser.ch(XMLEventReader.scala:59)
    at scala.xml.parsing.MarkupParserCommon$class.xName(MarkupParserCommon.scala:116)
    at scala.xml.pull.XMLEventReader$Parser.xName(XMLEventReader.scala:59)

it does continue reading without stopping.

[fancellu]

Knocked out a quick version with StaX, works fine on 4GB file.

https://gist.github.com/fancellu/745bb780adf938c39395

[ashawley]

I'm not able to verify this problem in a unit test. Nothing has changed in the XMLEventReader since, and maybe something changed in Java, Scala or the standard library, but probably not much. This test uses an infinite character stream as the source.

  @Test
  def largeSourceTest = {
    val src = new Source {
      val str = "<x><y z=''/>9</x>\n"
      lazy val elChars: Stream[Char] = str.toList.toStream #::: elChars
      protected val iter = elChars.toIterator
    }
    val reader = new XMLEventReader(src)
    reader.take(100)
    reader.stop
    src.close
  }

I even tried running it against a source of an actual 1G file , but I couldn't reproduce the issue.

[ashawley]

Closing as can't reproduce. If this is still an issue, we'll just need an example.