Cash subadditive risk measures without quasi convexity. In the literature of risk measures, cash subadditivity was proposed to replace cash additivity, motivated by the presence of stochastic or ambiguous interest rates and defaultable contingent claims. Cash subadditivity has been traditionally studied together with quasi convexity, in a way similar to cash additivity with convexity. In this paper, we study cash subadditive risk measures without quasi convexity. One of our major results is that a general cash subadditive risk measure can be represented as the lower envelope of a family of quasi convex and cash subadditive risk measures. Representation results of cash subadditive risk measures with some additional properties are also examined. The notion of quasi star shapedness, which is a natural analogue of star shapedness, is introduced and we obtain a corresponding representation result.


Rates of convergence of the partial wave expansion beyond Kato's cusp condition II evaluations for the prefactors on the ground state of the helium atom. This article is a continuation of our previous work (Phys. Rev. A 88, 032511 (2013)). The prefactors for the partial wave expansion of the helium atom are derived. Due to series of cancellations, the partial wave increments of the energy converge as L 2N 6 . The origin of these cancellations is identified from alternative expressions of the partial wave energies. There is some evidence that the assumptions of regularities for the exact wavefunction can be reduced.


Hausdorff approximations and volume of tubes of singular algebraic sets. We prove bounds for the volume of neighborhoods of algebraic sets, in the euclidean space or the sphere, in terms of the degree of the defining polynomials, the number of variables and the dimension of the algebraic set, without any smoothness assumption. This generalizes previous work of Lotz on smooth complete intersections in the euclidean space and of B "urgisser, Cucker and Lotz on hypersurfaces in the sphere, and gives a complete solution to Problem 17 in the book titled "Condition" by B "urgisser and Cucker.


Class Incremental Online Streaming Learning. A wide variety of methods have been developed to enable lifelong learning in conventional deep neural networks. However, to succeed, these methods require a batch' of samples to be available and visited multiple times during training. While this works well in a static setting, these methods continue to suffer in a more realistic situation where data arrives in emph online streaming manner . We empirically demonstrate that the performance of current approaches degrades if the input is obtained as a stream of data with the following restrictions (i) each instance comes one at a time and can be seen only once, and (ii) the input data violates the i.i.d assumption, i.e., there can be a class based correlation. We propose a novel approach (CIOSL) for the class incremental learning in an emph online streaming setting to address these challenges. The proposed approach leverages implicit and explicit dual weight regularization and experience replay. The implicit regularization is leveraged via the knowledge distillation, while the explicit regularization incorporates a novel approach for parameter regularization by learning the joint distribution of the buffer replay and the current sample. Also, we propose an efficient online memory replay and replacement buffer strategy that significantly boosts the model's performance. Extensive experiments and ablation on challenging datasets show the efficacy of the proposed method.


Unified Theory of Characteristic Modes Part II Tracking, Losses, and FEM Evaluation. This is the second component of a two part paper dealing with a unification of characteristic mode decomposition. This second part addresses modal tracking and losses and presents several numerical examples for both surface and volume based method of moment formulations. A new tracking algorithm based on algebraic properties of the transition matrix is developed, achieving excellent precision and requiring a very low number of frequency samples as compared to procedures previously reported in the literature. The transition matrix is further utilized to show that characteristic mode decomposition of lossy objects fails to deliver orthogonal far fields and to demonstrate how characteristic modes can be evaluated using the finite element method.


Gromov Witten Theory of Complete Intersections. We provide an inductive algorithm computing Gromov Witten invariants in all genera with arbitrary insertions of all smooth complete intersections in projective space. We also prove that all Gromov Witten classes of all smooth complete intersections in projective space belong to the tautological ring of the moduli space of stable curves. The main idea is to show that invariants with insertions of primitive cohomology classes are controlled by their monodromy and by invariants defined without primitive insertions but with imposed nodes in the domain curve. To compute these nodal Gromov Witten invariants, we introduce the new notion of nodal relative Gromov Witten invariants. We then prove a nodal degeneration formula and a relative splitting formula. These results for nodal relative Gromov Witten theory are stated in complete generality and are of independent interest.


ASMDD Arabic Speech Mispronunciation Detection Dataset. The largest dataset of Arabic speech mispronunciation detections in Egyptian dialogues is introduced. The dataset is composed of annotated audio files representing the top 100 words that are most frequently used in the Arabic language, pronounced by 100 Egyptian children (aged between 2 and 8 years old). The dataset is collected and annotated on segmental pronunciation error detections by expert listeners.


Acoustic modes of rapidly rotating ellipsoids subject to centrifugal gravity. The acoustic modes of a rotating fluid filled cavity can be used to determine the effective rotation rate of a fluid (since the resonant frequencies are modified by the flows). To be accurate, this method requires a prior knowledge of the acoustic modes in rotating fluids. Contrary to the Coriolis force, centrifugal gravity has received much less attention in the experimental context. Motivated by on going experiments in rotating ellipsoids, we study how global rotation and buoyancy modify the acoustic modes of fluid filled ellipsoids in isothermal (or isentropic) hydrostatic equilibrium. We go beyond the standard acoustic equation, which neglects solid body rotation and gravity, by deriving an exact wave equation for the acoustic velocity. We then solve the wave problem using a polynomial spectral method in ellipsoids, which is compared with finite element solutions of the primitive fluid dynamic equations. We show that the centrifugal acceleration has measurable effects on the acoustic frequencies when M Omega gtrsim 0.3 , where M Omega is the rotational Mach number defined as the ratio of the sonic and rotational time scales. Such a regime can be reached with experiments rotating at a few tens of Hz, by replacing air with a highly compressible gas (e.g. SF 6 or C 4 F 8 ).


EKTVQA Generalized use of External Knowledge to empower Scene Text in Text VQA. The open ended question answering task of Text VQA often requires reading and reasoning about rarely seen or completely unseen scene text content of an image. We address this zero shot nature of the problem by proposing the generalized use of external knowledge to augment our understanding of the scene text. We design a framework to extract, validate, and reason with knowledge using a standard multimodal transformer for vision language understanding tasks. Through empirical evidence and qualitative results, we demonstrate how external knowledge can highlight instance only cues and thus help deal with training data bias, improve answer entity type correctness, and detect multiword named entities. We generate results comparable to the state of the art on three publicly available datasets, under the constraints of similar upstream OCR systems and training data.


Towards Compact CNNs via Collaborative Compression. Channel pruning and tensor decomposition have received extensive attention in convolutional neural network compression. However, these two techniques are traditionally deployed in an isolated manner, leading to significant accuracy drop when pursuing high compression rates. In this paper, we propose a Collaborative Compression (CC) scheme, which joints channel pruning and tensor decomposition to compress CNN models by simultaneously learning the model sparsity and low rankness. Specifically, we first investigate the compression sensitivity of each layer in the network, and then propose a Global Compression Rate Optimization that transforms the decision problem of compression rate into an optimization problem. After that, we propose multi step heuristic compression to remove redundant compression units step by step, which fully considers the effect of the remaining compression space (i.e., unremoved compression units). Our method demonstrates superior performance gains over previous ones on various datasets and backbone architectures. For example, we achieve 52.9 FLOPs reduction by removing 48.4 parameters on ResNet 50 with only a Top 1 accuracy drop of 0.56 on ImageNet 2012.


Covert Channel Attack to Federated Learning Systems. Federated learning (FL) goes beyond traditional, centralized machine learning by distributing model training among a large collection of edge clients. These clients cooperatively train a global, e.g., cloud hosted, model without disclosing their local, private training data. The global model is then shared among all the participants which use it for local predictions. In this paper, we put forward a novel attacker model aiming at turning FL systems into covert channels to implement a stealth communication infrastructure. The main intuition is that, during federated training, a malicious sender can poison the global model by submitting purposely crafted examples. Although the effect of the model poisoning is negligible to other participants, and does not alter the overall model performance, it can be observed by a malicious receiver and used to transmit a single bit.


SPEAR Semi supervised Data Programming in Python. We present spear, an open source python library for data programming with semi supervision. The package implements several recent data programming approaches including facility to programmatically label and build training data. SPEAR facilitates textit weak supervision in the form of heuristics (or rules) and association of textit noisy labels to the training dataset. These textit noisy labels are aggregated to assign labels to the unlabeled data for downstream tasks. We have implemented several label aggregation approaches that aggregate the textit noisy labels and then train using the textit noisily labeled set in a cascaded manner. Our implementation also includes other approaches that textit jointly aggregate and train the model for text classification tasks. Thus, in our python package, we integrate several cascade and joint data programming approaches while also providing the facility of data programming by letting the user define labeling functions or rules. The code and tutorial notebooks are available at url https github.com decile team spear . Further, extensive documentation can be found at url https spear decile.readthedocs.io . Video tutorials demonstrating the usage of our package are available at https youtu.be SN9YYK4FlU0, https www.youtube.com watch?v qdukvO3B8YU, and https drive.google.com uc?export download confirm KY u id 1P0iOGHrIR1Te0sSeCB3hwdPpjzB44K33. We also present some real world use cases of spear.


MIMO OFDM Based Massive Connectivity With Frequency Selectivity Compensation. In this paper, we study how to efficiently and reliably detect active devices and estimate their channels in a multiple input multiple output (MIMO) orthogonal frequency division multiplexing (OFDM) based grant free non orthogonal multiple access (NOMA) system to enable massive machine type communications (mMTC). First, by exploiting the correlation of the channel frequency responses in narrow band mMTC, we propose a block wise linear channel model. Specifically, the continuous OFDM subcarriers in the narrow band are divided into several sub blocks and a linear function with only two variables (mean and slope) is used to approximate the frequency selective channel in each sub block. This significantly reduces the number of variables to be determined in channel estimation and the sub block number can be adjusted to reliably compensate the channel frequency selectivity. Second, we formulate the joint active device detection and channel estimation in the block wise linear system as a Bayesian inference problem. By exploiting the block sparsity of the channel matrix, we develop an efficient turbo message passing (Turbo MP) algorithm to resolve the Bayesian inference problem with near linear complexity. We further incorporate machine learning approaches into Turbo MP to learn unknown prior parameters. Numerical results demonstrate the superior performance of the proposed algorithm over state of the art algorithms.


The null set of a polytope, and the Pompeiu property for polytopes. We study the null set N( mathcal P ) of the Fourier Laplace transform of a polytope mathcal P subset mathbb R d , and we find that N( mathcal P ) does not contain (almost all) circles in mathbb R d . As a consequence, the null set does not contain the algebraic varieties z in mathbb C d mid z 1 2 dots z d 2 alpha 2 for each fixed alpha in mathbb C , and hence we get an explicit proof that the Pompeiu property is true for all polytopes. Our proof uses the Brion Barvinok theorem, which gives a concrete formulation for the Fourier Laplace transform of a polytope, and it also uses properties of Bessel functions. The original proof that polytopes (as well as other bodies) possess the Pompeiu property was given by Brown, Schreiber, and Taylor (1973) for dimension 2. Williams (1976) later observed that the same proof also works for d 2 and, using eigenvalues of the Laplacian, gave another proof valid for d geq 2 that polytopes have the Pompeiu property.


A Discriminative Semantic Ranker for Question Retrieval. Similar question retrieval is a core task in community based question answering (CQA) services. To balance the effectiveness and efficiency, the question retrieval system is typically implemented as multi stage rankers The first stage ranker aims to recall potentially relevant questions from a large repository, and the latter stages attempt to re rank the retrieved results. Most existing works on question retrieval mainly focused on the re ranking stages, leaving the first stage ranker to some traditional term based methods. However, term based methods often suffer from the vocabulary mismatch problem, especially on short texts, which may block the re rankers from relevant questions at the very beginning. An alternative is to employ embedding based methods for the first stage ranker, which compress texts into dense vectors to enhance the semantic matching. However, these methods often lose the discriminative power as term based methods, thus introduce noise during retrieval and hurt the recall performance. In this work, we aim to tackle the dilemma of the first stage ranker, and propose a discriminative semantic ranker, namely DenseTrans, for high recall retrieval. Specifically, DenseTrans is a densely connected Transformer, which learns semantic embeddings for texts based on Transformer layers. Meanwhile, DenseTrans promotes low level features through dense connections to keep the discriminative power of the learned representations. DenseTrans is inspired by DenseNet in computer vision (CV), but poses a new way to use the dense connectivity which is totally different from its original design purpose. Experimental results over two question retrieval benchmark datasets show that our model can obtain significant gain on recall against strong term based methods as well as state of the art embedding based methods.


The fully compressed subgroup membership problem. Suppose that F is a free group and k is a natural number. We show that the fully compressed membership problem for k generated subgroups of F is solvable in polynomial time. In order to do this, we adapt the theory of Stallings' foldings to handle edges with compressed labels. This partially answers a question of Markus Lohrey.


Compelling Colorings A generalization of the dominator chromatic number. We define a P compelling coloring as a proper coloring of the vertices of a graph such that every subset consisting of one vertex of each color has property P . The P compelling chromatic number is the minimum number of colors in such a coloring. We show that this notion generalizes the dominator and total dominator chromatic numbers, and provide some general bounds and algorithmic results. We also investigate the specific cases where P is that the subset contains at least one edge or that the subset is connected.


Flexible plasma multi jet source operated in radial discharge configuration. Following up a recent study describing a flexible plasma source operated in planar geometry, the performance of a cold atmospheric plasma jet (CAPJ) matrix emanating radially from a soft cylindrical surface in the open air is presented. The plasma device, which has a set of small outlets produced in its side surface, has a length of 12 cm and an outer diameter of 5.4 cm. The dielectric barrier discharge (DBD) sustaining the plasma jets is generated in helium flowing between two coaxial electrodes, which are separated by both an insulating tape and a cylindrical wall made of polymer foam. Two operation modes are considered four equidistant CAPJs at the same axial position (brush mode) and three aligned CAPJs at constant azimuthal angle (comb mode). All discharges, excited by 15 kHz AC voltages at 3.8 kV in amplitude, have resulted in uniform lengths and intensities of the jets. Consumed discharge powers of between 0.1 and 1 W have been estimated from current voltage measurements. Optical emission spectroscopy (OES) has shown the preponderance of hydroxyl groups, nitrogen molecules and helium atoms in the active DBD region and the jet afterglow zone. This new design of CAPJ anticipates promising applications for treating the inner surface of hollow and delicate components for activation or healing purposes.


CLOOB Modern Hopfield Networks with InfoLOOB Outperform CLIP. CLIP yielded impressive results on zero shot transfer learning tasks and is considered as a foundation model like BERT or GPT3. CLIP vision models that have a rich representation are pre trained using the InfoNCE objective and natural language supervision before they are fine tuned on the particular tasks. Though CLIP excels at zero shot transfer learning, it suffers from explaining away, that is, it focuses too much on few specific features and or insufficiently extracts the covariance structure in the data. The former problem of focusing on few features only is caused by a saturation of the InfoNCE objective, which is severe for high mutual information. The latter problem of insufficiently exploiting the covariance structure is caused by a deficiency in extracting feature associations and co occurrences. We introduce "Contrastive Leave One Out Boost" (CLOOB), which uses the InfoLOOB objective and modern Hopfield networks. In contrast to InfoNCE, the InfoLOOB objective (leave one out bound) does not saturate and works well for high mutual information. Modern Hopfield networks, on the other hand, allow to use retrieved embeddings, which have an enriched covariance structure via co occurrences of stored features. We compare CLOOB to CLIP after pre training on the Conceptual Captions and the YFCC dataset with respect to their zero shot transfer learning performance on other datasets. CLOOB consistently outperforms CLIP at zero shot transfer learning across all considered architectures and datasets.


Catch Me If You GAN Using Artificial Intelligence for Fake Log Generation. With artificial intelligence (AI) becoming relevant in various parts of everyday life, other technologies are already widely influenced by the new way of handling large amounts of data. Although widespread already, AI has had only punctual influences on the cybersecurity field specifically. Many techniques and technologies used by cybersecurity experts function through manual labor and barely draw on automation, e.g., logs are often reviewed manually by system admins for potentially malicious keywords. This work evaluates the use of a special type of AI called generative adversarial networks (GANs) for log generation. More precisely, three different generative adversarial networks, SeqGAN, MaliGAN, and CoT, are reviewed in this research regarding their performance, focusing on generating new logs as a means of deceiving system admins for red teams. Although static generators for fake logs have been around for a while, their produces are usually easy to reveal as such. Using AI as an approach to this problem has not been widely researched. Identified challenges consist of formatting, dates and times, and overall consistency. Summing up the results, GANs seem not to be a good fit for generating fake logs. Their capability to detect fake logs, however, might be of use in practical scenarios.


Automorphisms of the Koszul homology of a local ring. This work concerns the Koszul complex K of a commutative noetherian local ring R , with its natural structure as differential graded R algebra. It is proved that under diverse conditions, involving the multiplicative structure of H(K) , any dg R algebra automorphism of K induces the identity map on H(K) . In such cases, it is possible to define an action of the automorphism group of R on H(K) . On the other hand, numerous rings are described for which K has automorphisms that do not induce the identity on H(K) . For any R , it is shown that the group of automorphisms of H(K) induced by automorphisms of K is abelian.


Rotation translation coupling of a double headed brownian motor in a traveling wave potential. Considering a double headed Brownian motor moving with both translational and rotational degrees of freedom, we investigate the directed transport properties of the system in a traveling wave potential. It is found that the traveling wave provides the essential condition of the directed transport for the system, and at an appropriate angular frequency, the positive current can be optimized. A general current reversal appears by modulating the angular frequency of the traveling wave, noise intensity, external driving force and the rod length. By transforming the dynamical equation in traveling wave potential into that in a tilted potential, the mechanism of current reversal is analyzed. For both cases of Gaussian and Levy noises, the currents show similar dependence on the parameters. Moreover, the current in the tilted potential shows a typical stochastic resonance effect. The external driving force has also a resonance like effect on the current in the tilted potential. But the current in the traveling wave potential exhibits the reverse behaviors of that in the tilted potential. Besides, the currents obviously depend on the stability index of the Levy noise under certain conditions.


Blockchain as an IoT intermediary. Blockchain technology provides a private, secure, transparent decentralized exchange of data. Also, blockchain is not limited to a particular area, but it has a wide range of applications and can be integrated into a variety of Internet interactive systems. For example, the Internet of Things (IoT), supply chain tracking, Electronic Health Records (EHR), digital forensics, identity management, trustless payments, and other key business elements will all benefit from its implementation. Next layer solutions such as Ethereum 2.0, Polkadot, Cardano, and other Web 3.0 technologies provide developers versatility. Moreover, these platforms utilize smart contracts which are similar to standard, traditionalized software during development but offer key utilities to end users such as online wallets, secure data with transparent rules. Blockchain is receiving a lot of attention in educational technology (EduTech) as it aims to achieve a more transparent and multipurpose educational system. In addition to smart contract technology which defines how data should be registered, gathered and processed, blockchain can be used as an IoT intermediary for mobile usage. Therefore, we implemented an educational learning platform powered by blockchain technology to examine feasibility in industry and academic environment. In essence, this is a web application which is adapted to mobile platform and connected to blockchain for crucial data exchanges. In this paper we want to emphasize the potential of blockchain technology in multiple sectors as well as the need to really understand the underlying principles which are allowing disruptability of traditional centralized software solutions.


Actuarial strategy for pricing Asian options under a mixed fractional Brownian motion with jumps. The mixed fractional Brownian motion ( mfBm ) has become quite popular in finance, since it allows one to model long range dependence and self similarity while remaining, for certain values of the Hurst parameter, arbitrage free. In the present paper, we propose approximate closed form solutions for pricing arithmetic Asian options on an underlying described by the mfBm . Specifically, we consider both arithmetic Asian options and arithmetic Asian power options, and we obtain analytical formulas for pricing them based on a convenient approximation of the strike price. Both the standard mfBm and the mfBm with Poisson log normally distributed jumps are taken into account.


Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models. On October 14th, 2020, researchers from OpenAI, the Stanford Institute for Human Centered Artificial Intelligence, and other universities convened to discuss open research questions surrounding GPT 3, the largest publicly disclosed dense language model at the time. The meeting took place under Chatham House Rules. Discussants came from a variety of research backgrounds including computer science, linguistics, philosophy, political science, communications, cyber policy, and more. Broadly, the discussion centered around two main questions 1) What are the technical capabilities and limitations of large language models? 2) What are the societal effects of widespread use of large language models? Here, we provide a detailed summary of the discussion organized by the two themes above.


Speedup deep learning models on GPU by taking advantage of efficient unstructured pruning and bit width reduction. This work is focused on the pruning of some convolutional neural networks (CNNs) and improving theirs efficiency on graphic processing units (GPU) by using a direct sparse algorithm. The Nvidia deep neural network (cuDnn) library is the most effective implementations of deep learning (DL) algorithms for GPUs. GPUs are the most commonly used accelerators for deep learning computations. One of the most common techniques for improving the efficiency of CNN models is weight pruning and quantization. There are two main types of pruning structural and non structural. The first enables much easier acceleration on many type of accelerators, but with this type it is difficult to achieve a sparsity level and accuracy as high as that obtained with the second type. Non structural pruning with retraining can generate a weight tensors up to 90 or more of sparsity in some deep CNN models. In this article the pruning algorithm is presented which makes it possible to achieve high sparsity levels without accuracy drop. In the next stage the linear and non linear quantization is adapted for further time and footprint reduction. This paper is an extended of previously published paper concerning effective pruning techniques and present real models pruned with high sparsities and reduced precision which can achieve better performance than the CuDnn library.


Conservative DG Method for the Micro Macro Decomposition of the Vlasov Poisson Lenard Bernstein Model. The micro macro (mM) decomposition approach is considered for the numerical solution of the Vlasov Poisson Lenard Bernstein (VPLB) system, which is relevant for plasma physics applications. In the mM approach, the kinetic distribution function is decomposed as f mathcal E boldsymbol rho f g , where mathcal E is a local equilibrium distribution, depending on the macroscopic moments boldsymbol rho f int mathbb R boldsymbol e fdv langle boldsymbol e f rangle mathbb R , where boldsymbol e (1,v, frac 1 2 v 2 ) rm T , and g , the microscopic distribution, is defined such that langle boldsymbol e g rangle mathbb R 0 . We aim to design numerical methods for the mM decomposition of the VPLB system, which consists of coupled equations for boldsymbol rho f and g . To this end, we use the discontinuous Galerkin (DG) method for phase space discretization, and implicit explicit (IMEX) time integration, where the phase space advection terms are integrated explicitly and the collision operator is integrated implicitly. We give special consideration to ensure that the resulting mM method maintains the langle boldsymbol e g rangle mathbb R 0 constraint, which may be necessary for obtaining (i) satisfactory results in the collision dominated regime with coarse velocity resolution, and (ii) unambiguous conservation properties. The constraint preserving property is achieved through a consistent discretization of the equations governing the micro and macro components. We present numerical results that demonstrate the performance of the mM method. The mM method is also compared against a corresponding DG IMEX method solving directly for f .


Minimal Taylor Algebras as a Common Framework for the Three Algebraic Approaches to the CSP. This paper focuses on the algebraic theory underlying the study of the complexity and the algorithms for the Constraint Satisfaction Problem (CSP). We unify, simplify, and extend parts of the three approaches that have been developed to study the CSP over finite templates absorption theory that was used to characterize CSPs solvable by local consistency methods (JACM'14), and Bulatov's and Zhuk's theories that were used for two independent proofs of the CSP Dichotomy Theorem (FOCS'17, JACM'20). As the first contribution we present an elementary theorem about primitive positive definability and use it to obtain the starting points of Bulatov's and Zhuk's proofs as corollaries. As the second contribution we propose and initiate a systematic study of minimal Taylor algebras. This class of algebras is broad enough so that it suffices to verify the CSP Dichotomy Theorem on this class only, but still is unusually well behaved. In particular, many concepts from the three approaches coincide in the class, which is in striking contrast with the general setting. We believe that the theory initiated in this paper will eventually result in a simple and more natural proof of the Dichotomy Theorem that employs a simpler and more efficient algorithm, and will help in attacking complexity questions in other CSP related problems.


New Turan type bounds for Johnson graphs. In this paper, we consider the Johnson's graphs. We study the extremal properties of the Johnson's graphs. Namely, we investigate the number of edges in an arbitrary subgraph of this graph. Namely, in this article we prove analogs of Turan's 1941 theorem.


Faster Than Native Alternatives for x86 VP2INTERSECT Instructions. We present faster than native alternatives for the full AVX512 VP2INTERSECT instruction subset using basic AVX512F instructions. These alternatives compute only one of the output masks, which is sufficient for the typical case of computing the intersection of two sorted lists of integers, or computing the size of such an intersection. While the na "ive implementation (compare the first input vector against all rotations of the second) is slower than the native instructions, we show that by rotating both the first and second operands at the same time there is a significant saving in the total number of vector rotations, resulting in the emulations being faster than the native instructions, for all instructions in the VP2INTERSECT subset. Additionally, the emulations can be easily extended to other types of inputs (e.g. packed vectors of 16 bit integers) for which native instructions are not available.


On symbolic group varieties and dual surjunctivity. Let G be a group. Let X be an algebraic group over an algebraically closed field K . Denote by A X(K) the set of rational points of X . We study algebraic group cellular automata tau colon A G to A G whose local defining map is induced by a homomorphism of algebraic groups X M to X where M is a finite memory. When G is sofic and K is uncountable, we show that if tau is post surjective then it is weakly pre injective. Our result extends the dual version of Gottschalk's Conjecture for finite alphabets proposed by Capobianco, Kari, and Taati. When G is amenable, we prove that if tau is surjective then it is weakly pre injective, and conversely, if tau is pre injective then it is surjective. Hence, we obtain a complete answer to a question of Gromov on the Garden of Eden theorem in the case of algebraic group cellular automata.


Sasaki structures distinguished by their basic Hodge numbers. In all odd dimensions geq 5 we produce examples of manifolds admitting pairs of Sasaki structures with different basic Hodge numbers. In dimension 5 we prove more precise results, for example we show that on connected sums of copies of S 2 times S 3 the number of Sasaki structures with different basic Hodge numbers within a fixed homotopy class of almost contact structures is unbounded. All the Sasaki structures we consider are negative in the sense that the basic first Chern class is represented by a negative definite form of type (1,1) . We also discuss the relation of these results to contact topology.


Strict positive definiteness of convolutional and axially symmetric kernels on d dimensional spheres. The paper introduces new sufficient conditions of strict positive definiteness for kernels on d dimensional spheres which are not radially symmetric but possess specific coefficient structures. The results use the series expansion of the kernel in spherical harmonics. The kernels either have a convolutional form or are axially symmetric with respect to one axis. The given results on convolutional kernels generalise the result derived by Chen et al. 8 for radial kernels. Keywords strictly positive definite kernels, covariance functions, sphere


Jekyll Attacking Medical Image Diagnostics using Deep Generative Models. Advances in deep neural networks (DNNs) have shown tremendous promise in the medical domain. However, the deep learning tools that are helping the domain, can also be used against it. Given the prevalence of fraud in the healthcare domain, it is important to consider the adversarial use of DNNs in manipulating sensitive data that is crucial to patient healthcare. In this work, we present the design and implementation of a DNN based image translation attack on biomedical imagery. More specifically, we propose Jekyll, a neural style transfer framework that takes as input a biomedical image of a patient and translates it to a new image that indicates an attacker chosen disease condition. The potential for fraudulent claims based on such generated 'fake' medical images is significant, and we demonstrate successful attacks on both X rays and retinal fundus image modalities. We show that these attacks manage to mislead both medical professionals and algorithmic detection schemes. Lastly, we also investigate defensive measures based on machine learning to detect images generated by Jekyll.


The pyglaf argumentation reasoner (ICCMA2021). The pyglaf reasoner takes advantage of circumscription to solve computational problems of abstract argumentation frameworks. In fact, many of these problems are reduced to circumscription by means of linear encodings, and a few others are solved by means of a sequence of calls to an oracle for circumscription. Within pyglaf, Python is used to build the encodings and to control the execution of the external circumscription solver, which extends the SAT solver glucose and implements algorithms taking advantage of unsatisfiable core analysis and incremental computation.


An Abstraction based Method to Check Multi Agent Deep Reinforcement Learning Behaviors. Multi agent reinforcement learning (RL) often struggles to ensure the safe behaviours of the learning agents, and therefore it is generally not adapted to safety critical applications. To address this issue, we present a methodology that combines formal verification with (deep) RL algorithms to guarantee the satisfaction of formally specified safety constraints both in training and testing. The approach we propose expresses the constraints to verify in Probabilistic Computation Tree Logic (PCTL) and builds an abstract representation of the system to reduce the complexity of the verification step. This abstract model allows for model checking techniques to identify a set of abstract policies that meet the safety constraints expressed in PCTL. Then, the agents' behaviours are restricted according to these safe abstract policies. We provide formal guarantees that by using this method, the actions of the agents always meet the safety constraints, and provide a procedure to generate an abstract model automatically. We empirically evaluate and show the effectiveness of our method in a multi agent environment.


or2yw Modeling and Visualizing OpenRefineHistories as YesWorkflow Diagrams. OpenRefine is a popular open source data cleaning tool. It allows users to export a previously executed data cleaning workflow in a JSON format for possible reuse on other datasets. We have developed or2yw, a novel tool that maps a JSON formatted OpenRefine operation history to a YesWorkflow (YW) model, which then can be visualized and queried using the YW tool. The latter was originally developed to allow researchers a simple way to annotate their program scripts in order to reveal the workflow steps and dataflow dependencies implicit in those scripts. With or2yw the user can automatically generate YW models from OpenRefine operation histories, thus providing a 'workflow view' on a previously executed sequence of data cleaning operations. The or2yw tool can generate different types of YesWorkflow models, e.g., a linear model which mirrors the sequential execution order of operations in OpenRefine, and a emph parallel model which reveals independent workflow branches, based on a simple analysis of dependencies between steps if two operations are independent of each other (e.g., when the columns they read and write do not overlap) then these can be viewed as parallel steps in the data cleaning workflow. The resulting YW models can be understood as a form of prospective provenance, i.e., knowledge artifacts that can be queried and visualized (i) to help authors document their own data cleaning workflows, thereby increasing transparency, and (ii) to help other users, who might want to reuse such workflows, to understand them better.


Existence and convergence of solutions to fractional pure critical exponent problems. We study existence and convergence properties of least energy symmetric solutions (l.e.s.s.) to the pure critical problem begin equation ( Delta) su s u s 2 star s 2 u s, quad u s in D s 0( Omega), quad 2 star s frac 2N N 2s , end equation where s is any positive number, Omega is either mathbb R N or a smooth symmetric bounded domain, and D s 0( Omega) is the homogeneous Sobolev space. Depending on the kind of symmetry considered, solutions can be sign changing. We show that, up to a subsequence, a l.e.s.s. u s converges to a l.e.s.s. u t as s goes to any t 0 . In bounded domains, this convergence can be characterized in terms of an homogeneous fractional norm of order t varepsilon . A similar characterization is no longer possible in unbounded domains due to scaling invariance and an incompatibility with the functional spaces to circumvent these difficulties, we use a suitable rescaling and characterize the convergence via cut off functions. If t is an integer, these results describe in a precise way the nonlocal to local transition. Finally, we also include a nonexistence result of nontrivial nonnegative solutions in a ball for any s 1 .


Prime numbers of the form mathbf n c tan theta(log n) . Let , cdot , be the floor function. In the present paper we prove that when 1 c frac 12 11 and theta 1 is a fixed, then there exist infinitely many prime numbers of the form n c tan theta( log n) .


On the Mordell Weil Ranks of supersingular abelian varieties over mathbb Z p 2 extensions. Let p be a fixed odd prime and let K be an imaginary quadratic field in which p splits. Let A be an abelian variety defined over K with supersingular reduction at both primes above p in K . Under certain assumptions, we give a growth estimate for the Mordell Weil rank of A over finite extensions inside the mathbb Z p 2 extension of K . In the last section, written by Chris Williams, he includes some speculative remarks on the p adic L functions for mathrm GSp (4) corresponding to the multi signed Selmer groups constructed in this paper.


TinyFedTL Federated Transfer Learning on Tiny Devices. TinyML has rose to popularity in an era where data is everywhere. However, the data that is in most demand is subject to strict privacy and security guarantees. In addition, the deployment of TinyML hardware in the real world has significant memory and communication constraints that traditional ML fails to address. In light of these challenges, we present TinyFedTL, the first implementation of federated transfer learning on a resource constrained microcontroller.


Learning from Matured Dumb Teacher for Fine Generalization. The flexibility of decision boundaries in neural networks that are unguided by training data is a well known problem typically resolved with generalization methods. A surprising result from recent knowledge distillation (KD) literature is that random, untrained, and equally structured teacher networks can also vastly improve generalization performance. It raises the possibility of existence of undiscovered assumptions useful for generalization on an uncertain region. In this paper, we shed light on the assumptions by analyzing decision boundaries and confidence distributions of both simple and KD based generalization methods. Assuming that a decision boundary exists to represent the most general tendency of distinction on an input sample space (i.e., the simplest hypothesis), we show the various limitations of methods when using the hypothesis. To resolve these limitations, we propose matured dumb teacher based KD, conservatively transferring the hypothesis for generalization of the student without massive destruction of trained information. In practical experiments on feed forward and convolution neural networks for image classification tasks on MNIST, CIFAR 10, and CIFAR 100 datasets, the proposed method shows stable improvement to the best test performance in the grid search of hyperparameters. The analysis and results imply that the proposed method can provide finer generalization than existing methods.


CTC based Compression for Direct Speech Translation. Previous studies demonstrated that a dynamic phone informed compression of the input audio is beneficial for speech translation (ST). However, they required a dedicated model for phone recognition and did not test this solution for direct ST, in which a single model translates the input audio into the target language without intermediate representations. In this work, we propose the first method able to perform a dynamic compression of the input indirect ST models. In particular, we exploit the Connectionist Temporal Classification (CTC) to compress the input sequence according to its phonetic characteristics. Our experiments demonstrate that our solution brings a 1.3 1.5 BLEU improvement over a strong baseline on two language pairs (English Italian and English German), contextually reducing the memory footprint by more than 10 .


A Robust Physics based Method to Filter Coherent Wavepackets from High speed Schlieren Images. A complete understanding of jet dynamics is greatly enabled by accurate separation of the acoustically efficient wavepackets from their higher energy convecting turbulent counterparts. Recent developments using Momentum Potential Theory (MPT) have successfully isolated the acoustic component in all regions of the jet, to better understand the dynamics as well as to develop wavepacket models. MPT is however a data intensive method since the inherent Poisson equation solution requires fluctuation quantities in the entire flowfield as such, it has to date been applied only to numerically obtained data. This work develops an approach to extend its application to extract coherent wavepackets from high speed schlieren images. The procedure maps pixel intensities from the schlieren to a scaled surrogate for the density gradient integrated along the line of sight. The effectiveness of the procedure is demonstrated using experimental as well as simulated schlieren images representing a wide range of imperfectly expanded free and impinging jet configurations. When combined with Spectral Proper Orthogonal Decomposition, the method yields modes that accurately capture (i) the Mach wave radiation from a military style jet, (ii) the mode shapes of the feedback tones in an impinging jet, and (iii) the screech signature in twin rectangular jets, without recourse to user adjusted parameters. This technique has the potential to greatly expand the use of high speed diagnostics and provide real time monitoring of the acoustic content of the jet in the nearfield, with feedback control implications. Additionally, although the present study focuses on jets, the general nature of the approach allows a straightforward application to other flows, such as cavity flow acoustic interactions, among others.


Tensor regularization by truncated iteration a comparison of some solution methods for large scale linear discrete ill posed problem with a t product. This paper describes and compares some structure preserving techniques for the solution of linear discrete ill posed problems with the t product. A new randomized tensor singular value decomposition (R tSVD) with a t product is presented for low tubal rank tensor approximations. Regularization of linear inverse problems by truncated tensor eigenvalue decomposition (T tEVD), truncated tSVD (T tSVD), randomized T tSVD (RT tSVD), t product Golub Kahan bidiagonalization (tGKB) process, and t product Lanczos (t Lanczos) process are considered. A solution method that is based on reusing tensor Krylov subspaces generated by the tGKB process is described. The regularization parameter is the number of iterations required by each method. The discrepancy principle is used to determine this parameter. Solution methods that are based on truncated iterations are compared with solution methods that combine Tikhonov regularization with the tGKB and t Lanczos processes. Computed examples illustrate the performance of these methods when applied to image and gray scale video restorations. Our new RT tSVD method is seen to require less CPU time and yields restorations of higher quality than the T tSVD method.


Constructive and Toxic Speech Detection for Open domain Social Media Comments in Vietnamese. The rise of social media has led to the increasing of comments on online forums. However, there still exists invalid comments which are not informative for users. Moreover, those comments are also quite toxic and harmful to people. In this paper, we create a dataset for constructive and toxic speech detection, named UIT ViCTSD (Vietnamese Constructive and Toxic Speech Detection dataset) with 10,000 human annotated comments. For these tasks, we propose a system for constructive and toxic speech detection with the state of the art transfer learning model in Vietnamese NLP as PhoBERT. With this system, we obtain F1 scores of 78.59 and 59.40 for classifying constructive and toxic comments, respectively. Besides, we implement various baseline models as traditional Machine Learning and Deep Neural Network Based models to evaluate the dataset. With the results, we can solve several tasks on the online discussions and develop the framework for identifying constructiveness and toxicity of Vietnamese social media comments automatically.


Flow approaches to community detection in complex network systems. The paper investigates the problem of finding communities in complex network systems, the detection of which allows a better understanding of the laws of their functioning. To solve this problem, two approaches are proposed based on the use of flows characteristics of complex network. The first of these approaches consists in calculating the parameters of influence of separate subsystems of the network system, distinguished by the principles of ordering or subordination, and the second, in using the concept of its flow core. Based on the proposed approaches, reliable criteria for finding communities have been formulated and efficient algorithms for their detection in complex network systems have been developed. It is shown that the proposed approaches make it possible to single out communities in cases in which the existing numerical and visual methods turn out to be disabled.


Video Temporal Relationship Mining for Data Efficient Person Re identification. This paper is a technical report to our submission to the ICCV 2021 VIPriors Re identification Challenge. In order to make full use of the visual inductive priors of the data, we treat the query and gallery images of the same identity as continuous frames in a video sequence. And we propose one novel post processing strategy for video temporal relationship mining, which not only calculates the distance matrix between query and gallery images, but also the matrix between gallery images. The initial query image is used to retrieve the most similar image from the gallery, then the retrieved image is treated as a new query to retrieve its most similar image from the gallery. By iteratively searching for the closest image, we can achieve accurate image retrieval and finally obtain a robust retrieval sequence.


A Physics Data Driven Bayesian Method for Heat Conduction Problems. In this study, a novel physics data driven Bayesian method named Heat Conduction Equation assisted Bayesian Neural Network (HCE BNN) is proposed. The HCE BNN is constructed based on the Bayesian neural network, it is a physics informed machine learning strategy. Compared with the existed pure data driven method, to acquire physical consistency and better performance of the data driven model, the heat conduction equation is embedded into the loss function of the HCE BNN as a regularization term. Hence, the proposed method can build a more reliable model by physical constraints with less data. The HCE BNN can handle the forward and inverse problems consistently, that is, to infer unknown responses from known partial responses, or to identify boundary conditions or material parameters from known responses. Compared with the exact results, the test results demonstrate that the proposed method can be applied to both heat conduction forward and inverse problems successfully. In addition, the proposed method can be implemented with the noisy data and gives the corresponding uncertainty quantification for the solutions.


Real Time RGBD Odometry for Fused State Navigation Systems. This article describes an algorithm that provides visual odometry estimates from sequential pairs of RGBD images. The key contribution of this article on RGBD odometry is that it provides both an odometry estimate and a covariance for the odometry parameters in real time via a representative covariance matrix. Accurate, real time parameter covariance is essential to effectively fuse odometry measurements into most navigation systems. To date, this topic has seen little treatment in research which limits the impact existing RGBD odometry approaches have for localization in these systems. Covariance estimates are obtained via a statistical perturbation approach motivated by real world models of RGBD sensor measurement noise. Results discuss the accuracy of our RGBD odometry approach with respect to ground truth obtained from a motion capture system and characterizes the suitability of this approach for estimating the true RGBD odometry parameter uncertainty.


Prescribed Webster scalar curvatures on compact pseudo Hermitian manifolds. In this paper, we investigate the problem of prescribing Webster scalar curvatures on compact pseudo Hermitian manifolds. In terms of the method of upper and lower solutions and the perturbation theory of self adjoint operators, we can describe some sets of Webster scalar curvature functions which can be realized through pointwise CR conformal deformations and CR conformally equivalent deformations respectively from a given pseudo Hermitian structure.


Kinetic simulations of collision less plasmas in open magnetic geometries. Laboratory plasmas in open magnetic geometries can be found in many different applications such as (1) Scrape Of Layer (SOL) and divertor regions in toroidal confinement fusion devices ( approx1 10 2 hspace 1mm mathrm eV ), (2) linear divertor simulators ( approx1 10 hspace 1mm mathrm eV ), (3) plasma based thrusters ( approx10 hspace 1mm mathrm eV ) and (4) magnetic mirrors ( approx10 2 10 3 hspace 1mm mathrm eV ). A common feature of these plasma systems is the need to resolve, in addition to velocity space, at least one physical dimension (e.g. along flux lines) to capture the relevant physics. In general, this requires a kinetic treatment. Fully kinetic Particle In Cell (PIC) simulations can be applied but at the expense of large computational effort. A common way to resolve this is to use a hybrid approach kinetic ions and fluid electrons. In the present work, the development of a hybrid PIC computational tool suitable for open magnetic geometries is described which includes (1) the effect of non uniform magnetic fields, (2) finite fully absorbing boundaries for the particles and (3) volumetric particle sources. Analytical expressions for the momentum transport in the paraxial limit are presented with their underlying assumptions and are used to validate the results from the PIC simulations. The self consistent electric field is calculated and is shown to modify the ion velocity distribution function in manner consistent with analytic theory. Based on this analysis, the ion distribution function is understood in terms of a loss cone distribution and an isotropic Maxwell Boltzmann distribution driven by a volumetric plasma source. Finally, inclusion of a Monte Carlo based Fokker Planck collision operator is discussed in the context of future work.


MinConvNets A new class of multiplication less Neural Networks. Convolutional Neural Networks have achieved unprecedented success in image classification, recognition, or detection applications. However, their large scale deployment in embedded devices is still limited by the huge computational requirements, i.e., millions of MAC operations per layer. In this article, MinConvNets where the multiplications in the forward propagation are approximated by minimum comparator operations are introduced. Hardware implementation of minimum operation is much simpler than multipliers. Firstly, a methodology to find approximate operations based on statistical correlation is presented. We show that it is possible to replace multipliers by minimum operations in the forward propagation under certain constraints, i.e. given similar mean and variances of the feature and the weight vectors. A modified training method which guarantees the above constraints is proposed. And it is shown that equivalent precision can be achieved during inference with MinConvNets by using transfer learning from well trained exact CNNs.


Algorithmic Audit of Italian Car Insurance Evidence of Unfairness in Access and Pricing. We conduct an audit of pricing algorithms employed by companies in the Italian car insurance industry, primarily by gathering quotes through a popular comparison website. While acknowledging the complexity of the industry, we find evidence of several problematic practices. We show that birthplace and gender have a direct and sizeable impact on the prices quoted to drivers, despite national and international regulations against their use. Birthplace, in particular, is used quite frequently to the disadvantage of foreign born drivers and drivers born in certain Italian cities. In extreme cases, a driver born in Laos may be charged 1,000 euros more than a driver born in Milan, all else being equal. For a subset of our sample, we collect quotes directly on a company website, where the direct influence of gender and birthplace is confirmed. Finally, we find that drivers with riskier profiles tend to see fewer quotes in the aggregator result pages, substantiating concerns of differential treatment raised in the past by Italian insurance regulators.


On Oriented Diameter of (n, k) Star Graphs. Assignment of one of the two possible directions to every edge of an undirected graph G (V,E) is called an orientation of G . The resulting directed graph is denoted by overrightarrow G . A strong orientation is one in which every vertex is reachable from every other vertex via a directed path. The diameter of overrightarrow G , i.e., the maximum distance from one vertex to another, depends on the particular orientation. The minimum diameter among all possible orientations is called the oriented diameter overrightarrow text diam (G) of G . Let n,k be two integers with 1 leq k n . In the realm of interconnection networks of processing elements, an (n,k) star graph S n,k offers a topology that circumvents the lack of scalability of n star graphs S n . In this paper, we present a strong orientation for S n,k that combines approaches suggested by Cheng and Lipman Journal of Interconnection Networks (2002) for S n,k with the one proposed by Fujita The First International Symposium on Computing and Networking (CANDAR 2013) for S n . Next, we propose a distributed routing algorithm for overrightarrow S n,k inspired by an algorithm proposed by Kumar, Rajendraprasad and Sudeep Discrete Applied Mathematics (2021) for overrightarrow S n . With the aid of both the orientation scheme and the routing algorithm, we show that overrightarrow text diam (S n,k ) leq lfloor frac n k 2 rfloor 2k 6 delta(n,k) where delta(n,k) is a non negative function. The function delta(n,k) takes on values 2k n , 0 , and left lfloor frac n 3k 2 right rfloor respectively for three disjoint intervals k frac n 2 , frac n 3 k leq frac n 2 and k leq frac n 3 . For every value of n , k , our upper bound performs better than all known bounds in literature.


An In Memory Analog Computing Co Processor for Energy Efficient CNN Inference on Mobile Devices. In this paper, we develop an in memory analog computing (IMAC) architecture realizing both synaptic behavior and activation functions within non volatile memory arrays. Spin orbit torque magnetoresistive random access memory (SOT MRAM) devices are leveraged to realize sigmoidal neurons as well as binarized synapses. First, it is shown the proposed IMAC architecture can be utilized to realize a multilayer perceptron (MLP) classifier achieving orders of magnitude performance improvement compared to previous mixed signal and digital implementations. Next, a heterogeneous mixed signal and mixed precision CPU IMAC architecture is proposed for convolutional neural networks (CNNs) inference on mobile processors, in which IMAC is designed as a co processor to realize fully connected (FC) layers whereas convolution layers are executed in CPU. Architecture level analytical models are developed to evaluate the performance and energy consumption of the CPU IMAC architecture. Simulation results exhibit 6.5 and 10 energy savings for CPU IMAC based realizations of LeNet and VGG CNN models, for MNIST and CIFAR 10 pattern recognition tasks, respectively.


A Koopman Approach to Understanding Sequence Neural Models. We introduce a new approach to understanding trained sequence neural models the Koopman Analysis of Neural Networks (KANN) method. Motivated by the relation between time series models and self maps, we compute approximate Koopman operators that encode well the latent dynamics. Unlike other existing methods whose applicability is limited, our framework is global, and it has only weak constraints over the inputs. Moreover, the Koopman operator is linear, and it is related to a rich mathematical theory. Thus, we can use tools and insights from linear analysis and Koopman Theory in our study. For instance, we show that the operator eigendecomposition is instrumental in exploring the dominant features of the network. Our results extend across tasks and architectures as we demonstrate for the copy problem, and ECG classification and sentiment analysis tasks.


Autonomous Driving Data Chain Interfaces. Recent developments in autonomous driving technology have proven that map data may be used, not only for general routing purposes, but also for to enhance and complement common sensor data. This document reviews the most commonly used interfaces and formats at each step of a selfhealing map data chain.


GDR Net Geometry Guided Direct Regression Network for Monocular 6D Object Pose Estimation. 6D pose estimation from a single RGB image is a fundamental task in computer vision. The current top performing deep learning based methods rely on an indirect strategy, i.e., first establishing 2D 3D correspondences between the coordinates in the image plane and object coordinate system, and then applying a variant of the P n P RANSAC algorithm. However, this two stage pipeline is not end to end trainable, thus is hard to be employed for many tasks requiring differentiable poses. On the other hand, methods based on direct regression are currently inferior to geometry based methods. In this work, we perform an in depth investigation on both direct and indirect methods, and propose a simple yet effective Geometry guided Direct Regression Network (GDR Net) to learn the 6D pose in an end to end manner from dense correspondence based intermediate geometric representations. Extensive experiments show that our approach remarkably outperforms state of the art methods on LM, LM O and YCB V datasets. Code is available at https git.io GDR Net.


SegMix Co occurrence Driven Mixup for Semantic Segmentation and Adversarial Robustness. In this paper, we present a strategy for training convolutional neural networks to effectively resolve interference arising from competing hypotheses relating to inter categorical information throughout the network. The premise is based on the notion of feature binding, which is defined as the process by which activations spread across space and layers in the network are successfully integrated to arrive at a correct inference decision. In our work, this is accomplished for the task of dense image labelling by blending images based on (i) categorical clustering or (ii) the co occurrence likelihood of categories. We then train a feature binding network which simultaneously segments and separates the blended images. Subsequent feature denoising to suppress noisy activations reveals additional desirable properties and high degrees of successful predictions. Through this process, we reveal a general mechanism, distinct from any prior methods, for boosting the performance of the base segmentation and saliency network while simultaneously increasing robustness to adversarial attacks.


Natural Language Video Localization with Learnable Moment Proposals. Given an untrimmed video and a natural language query, Natural Language Video Localization (NLVL) aims to identify the video moment described by the query. To address this task, existing methods can be roughly grouped into two groups 1) propose and rank models first define a set of hand designed moment candidates and then find out the best matching one. 2) proposal free models directly predict two temporal boundaries of the referential moment from frames. Currently, almost all the propose and rank methods have inferior performance than proposal free counterparts. In this paper, we argue that propose and rank approach is underestimated due to the predefined manners 1) Hand designed rules are hard to guarantee the complete coverage of targeted segments. 2) Densely sampled candidate moments cause redundant computation and degrade the performance of ranking process. To this end, we propose a novel model termed LPNet (Learnable Proposal Network for NLVL) with a fixed set of learnable moment proposals. The position and length of these proposals are dynamically adjusted during training process. Moreover, a boundary aware loss has been proposed to leverage frame level information and further improve the performance. Extensive ablations on two challenging NLVL benchmarks have demonstrated the effectiveness of LPNet over existing state of the art methods.


Language bias in Visual Question Answering A Survey and Taxonomy. Visual question answering (VQA) is a challenging task, which has attracted more and more attention in the field of computer vision and natural language processing. However, the current visual question answering has the problem of language bias, which reduces the robustness of the model and has an adverse impact on the practical application of visual question answering. In this paper, we conduct a comprehensive review and analysis of this field for the first time, and classify the existing methods according to three categories, including enhancing visual information, weakening language priors, data enhancement and training strategies. At the same time, the relevant representative methods are introduced, summarized and analyzed in turn. The causes of language bias are revealed and classified. Secondly, this paper introduces the datasets mainly used for testing, and reports the experimental results of various existing methods. Finally, we discuss the possible future research directions in this field.


Non classical polynomials and the inverse theorem. In this note we characterize when non classical polynomials are necessary in the inverse theorem for the Gowers U k norm. We give a brief deduction of the fact that a bounded function on mathbb F p n with large U k norm must correlate with a classical polynomial when k leq p 1 . To the best of our knowledge, this result is new for k p 1 (when p 2 ). We then prove that non classical polynomials are necessary in the inverse theorem for the Gowers U k norm over mathbb F p n for all k geq p 2 , completely characterizing when classical polynomials suffice.


A Physics Informed Deep Learning Paradigm for Traffic State and Fundamental Diagram Estimation. Traffic state estimation (TSE) bifurcates into two categories, model driven and data driven (e.g., machine learning, ML), while each suffers from either deficient physics or small data. To mitigate these limitations, recent studies introduced a hybrid paradigm, physics informed deep learning (PIDL), which contains both model driven and data driven components. This paper contributes an improved version, called physics informed deep learning with a fundamental diagram learner (PIDL FDL), which integrates ML terms into the model driven component to learn a functional form of a fundamental diagram (FD), i.e., a mapping from traffic density to flow or velocity. The proposed PIDL FDL has the advantages of performing the TSE learning, model parameter identification, and FD estimation simultaneously. We demonstrate the use of PIDL FDL to solve popular first order and second order traffic flow models and reconstruct the FD relation as well as model parameters that are outside the FD terms. We then evaluate the PIDL FDL based TSE using the Next Generation SIMulation (NGSIM) dataset. The experimental results show the superiority of the PIDL FDL in terms of improved estimation accuracy and data efficiency over advanced baseline TSE methods, and additionally, the capacity to properly learn the unknown underlying FD relation.


Reading StackOverflow Encourages Cheating Adding Question Text Improves Extractive Code Generation. Answering a programming question using only its title is difficult as salient contextual information is omitted. Based on this observation, we present a corpus of over 40,000 StackOverflow question texts to be used in conjunction with their corresponding intents from the CoNaLa dataset (Yin et al., 2018). Using both the intent and question body, we use BART to establish a baseline BLEU score of 34.35 for this new task. We find further improvements of 2.8 by combining the mined CoNaLa data with the labeled data to achieve a 35.32 BLEU score. We evaluate prior state of the art CoNaLa models with this additional data and find that our proposed method of using the body and mined data beats the BLEU score of the prior state of the art by 71.96 . Finally, we perform ablations to demonstrate that BART is an unsupervised multimodal learner and examine its extractive behavior. The code and data can be found https github.com gabeorlanski stackoverflow encourages cheating.


Time harmonic solutions for Maxwell's equations in anisotropic media and Bochner Riesz estimates with negative index for non elliptic surfaces. We solve time harmonic Maxwell's equations in anisotropic, spatially homogeneous media in intersections of L p spaces. The material laws are time independent. The analysis requires Fourier restriction extension estimates for perturbations of Fresnel's wave surface. This surface can be decomposed into finitely many components of the following three types smooth surfaces with non vanishing Gaussian curvature, smooth surfaces with Gaussian curvature vanishing along one dimensional submanifolds, but without flat points, and surfaces with conical singularities. Our estimates are based on new Bochner Riesz estimates with negative index for non elliptic surfaces.


Local Morphometry of Closed, Implicit Surfaces. Anatomical structures such as the hippocampus, liver, and bones can be analyzed as orientable, closed surfaces. This permits the computation of volume, surface area, mean curvature, Gaussian curvature, and the Euler Poincar 'e characteristic as well as comparison of these morphometrics between structures of different topology. The structures are commonly represented implicitly in curve evolution problems as the zero level set of an embedding. Practically, binary images of anatomical structures are embedded using a signed distance transform. However, quantization prevents the accurate computation of curvatures, leading to considerable errors in morphometry. This paper presents a fast, simple embedding procedure for accurate local morphometry as the zero crossing of the Gaussian blurred binary image. The proposed method was validated based on the femur and fourth lumbar vertebrae of 50 clinical computed tomography datasets. The results show that the signed distance transform leads to large quantization errors in the computed local curvature. Global validation of morphometry using regression and Bland Altman analysis revealed that the coefficient of determination for the average mean curvature is improved from 93.8 with the signed distance transform to 100 with the proposed method. For the surface area, the proportional bias is improved from 5.0 for the signed distance transform to 0.6 for the proposed method. The Euler Poincar 'e characteristic is improved from unusable in the signed distance transform to 98 accuracy for the proposed method. The proposed method enables an improved local and global evaluation of curvature for purposes of morphometry on closed, implicit surfaces.


Improved Variance Aware Confidence Sets for Linear Bandits and Linear Mixture MDP. This paper presents new emph variance aware confidence sets for linear bandits and linear mixture Markov Decision Processes (MDPs). With the new confidence sets, we obtain the follow regret bounds For linear bandits, we obtain an tilde O (poly(d) sqrt 1 sum k 1 K sigma k 2 ) data dependent regret bound, where d is the feature dimension, K is the number of rounds, and sigma k 2 is the emph unknown variance of the reward at the k th round. This is the first regret bound that only scales with the variance and the dimension but emph no explicit polynomial dependency on K . When variances are small, this bound can be significantly smaller than the tilde Theta left(d sqrt K right) worst case regret bound. For linear mixture MDPs, we obtain an tilde O (poly(d, log H) sqrt K ) regret bound, where d is the number of base models, K is the number of episodes, and H is the planning horizon. This is the first regret bound that only scales emph logarithmically with H in the reinforcement learning with linear function approximation setting, thus emph exponentially improving existing results, and resolving an open problem in citep zhou2020nearly . We develop three technical ideas that may be of independent interest 1) applications of the peeling technique to both the input norm and the variance magnitude, 2) a recursion based estimator for the variance, and 3) a new convex potential lemma that generalizes the seminal elliptical potential lemma.


Exploring the Assessment List for Trustworthy AI in the Context of Advanced Driver Assistance Systems. Artificial Intelligence (AI) is increasingly used in critical applications. Thus, the need for dependable AI systems is rapidly growing. In 2018, the European Commission appointed experts to a High Level Expert Group on AI (AI HLEG). AI HLEG defined Trustworthy AI as 1) lawful, 2) ethical, and 3) robust and specified seven corresponding key requirements. To help development organizations, AI HLEG recently published the Assessment List for Trustworthy AI (ALTAI). We present an illustrative case study from applying ALTAI to an ongoing development project of an Advanced Driver Assistance System (ADAS) that relies on Machine Learning (ML). Our experience shows that ALTAI is largely applicable to ADAS development, but specific parts related to human agency and transparency can be disregarded. Moreover, bigger questions related to societal and environmental impact cannot be tackled by an ADAS supplier in isolation. We present how we plan to develop the ADAS to ensure ALTAI compliance. Finally, we provide three recommendations for the next revision of ALTAI, i.e., life cycle variants, domain specific adaptations, and removed redundancy.


Asymptotic equidistribution for partition statistics and topological invariants. We provide a general framework for proving asymptotic equidistribution, convexity, and log concavity of coefficients of generating functions on arithmetic progressions. Our central tool is a variant of Wright's Circle Method proved by two of the authors with Bringmann and Ono, following work of Ngo and Rhoades. We offer a selection of different examples of such results, proving asymptotic equidistribution results for several partition statistics, modular sums of Betti numbers of two and three flag Hilbert schemes, and the number of cells of dimension a (mod b) of a certain scheme central in work of G "ottsche.


Timing of the solar wind propagation delay between L1 and Earth based on machine learning. Erroneous GNSS positioning, failures in spacecraft operations and power outages due to geomagnetically induced currents are severe threats originating from space weather. Having knowledge of potential impacts on modern society in advance is key for many end user applications. This covers not only the timing of severe geomagnetic storms but also predictions of substorm onsets at polar latitudes. In this study we aim at contributing to the timing problem of space weather impacts and propose a new method to predict the solar wind propagation delay between Lagrangian point L1 and the Earth based on machine learning, specifically decision tree models. The propagation delay is measured from the identification of interplanetary discontinuities detected by the Advanced Composition Explorer (ACE) and their subsequent sudden commencements in the magnetosphere recorded by ground based magnetometers. A database of the propagation delay has been constructed on this principle including 380 interplanetary shocks. The feature set consists of six features, the three components of each the solar wind speed and position of ACE around L1. The machine learning results are compared to the flat propagation delay and the method based on the normal vector of solar wind discontinuities (vector delay). The ML model achieves an RMSE of 4.5 min with respect to the measured solar wind propagation delay and also outperforms the physical flat and vector delay models by 50 and 15 respectively. To increase the confidence in the predictions of the trained GB model, we perform a performance validation, provide feature importance and analyse the feature impact on the model output with Shapley values. The major advantage of the machine learning approach is its simplicity when it comes to its application. After training, input from only one ACE datapoint have to be fed into the algorithm for a prediction.


Calibrating Explore Exploit Trade off for Fair Online Learning to Rank. Online learning to rank (OL2R) has attracted great research interests in recent years, thanks to its advantages in avoiding expensive relevance labeling as required in offline supervised ranking model learning. Such a solution explores the unknowns (e.g., intentionally present selected results on top positions) to improve its relevance estimation. This however triggers concerns on its ranking fairness different groups of items might receive differential treatments during the course of OL2R. But existing fair ranking solutions usually require the knowledge of result relevance or a performing ranker beforehand, which contradicts with the setting of OL2R and thus cannot be directly applied to guarantee fairness. In this work, we propose a general framework to achieve fairness defined by group exposure in OL2R. The key idea is to calibrate exploration and exploitation for fairness control, relevance learning and online ranking quality. In particular, when the model is exploring a set of results for relevance feedback, we confine the exploration within a subset of random permutations, where fairness across groups is maintained while the feedback is still unbiased. Theoretically we prove such a strategy introduces minimum distortion in OL2R's regret to obtain fairness. Extensive empirical analysis is performed on two public learning to rank benchmark datasets to demonstrate the effectiveness of the proposed solution compared to existing fair OL2R solutions.


Learning Rich Features for Gait Recognition by Integrating Skeletons and Silhouettes. Gait recognition captures gait patterns from the walking sequence of an individual for identification. Most existing gait recognition methods learn features from silhouettes or skeletons for the robustness to clothing, carrying, and other exterior factors. The combination of the two data modalities, however, is not fully exploited. Previous multimodal gait recognition methods mainly employ the skeleton to assist the local feature extraction where the intrinsic discrimination of the skeleton data is ignored. This paper proposes a simple yet effective Bimodal Fusion (BiFusion) network which mines discriminative gait patterns in skeletons and integrates with silhouette representations to learn rich features for identification. Particularly, the inherent hierarchical semantics of body joints in a skeleton is leveraged to design a novel Multi Scale Gait Graph (MSGG) network for the feature extraction of skeletons. Extensive experiments on CASIA B and OUMVLP demonstrate both the superiority of the proposed MSGG network in modeling skeletons and the effectiveness of the bimodal fusion for gait recognition. Under the most challenging condition of walking in different clothes on CASIA B, our method achieves the rank 1 accuracy of 92.1 .


Minimal free resolutions of sheaves on the projective plane and the stable base locus decomposition of their moduli spaces. The purpose of this paper is to incorporate minimal free resolutions into the study of the birational geometry of the moduli space of coherent sheaves on the plane with character xi , denoted by M( xi) . We show that it is possible to recover the relevant Bridgeland destabilizing object from the minimal free resolution in order to compute the effective cone mathrm Eff (M( xi)) and conjecture a full relationship between Bridgeland destabilizing objects and minimal free resolutions. Moreover, we also prove that minimal free resolutions, paired with interpolation for vector bundles, yield the movable cone of the Hilbert scheme of n points on the plane mathbb P 2 n , for certain values of n . We propose a program that computes the full stable base locus decomposition of mathbb P 2 n based on free resolutions and interpolation. We show that this programs yields correct answers for small values of n .


Accelerating GAN training using highly parallel hardware on public cloud. With the increasing number of Machine and Deep Learning applications in High Energy Physics, easy access to dedicated infrastructure represents a requirement for fast and efficient R D. This work explores different types of cloud services to train a Generative Adversarial Network (GAN) in a parallel environment, using Tensorflow data parallel strategy. More specifically, we parallelize the training process on multiple GPUs and Google Tensor Processing Units (TPU) and we compare two algorithms the TensorFlow built in logic and a custom loop, optimised to have higher control of the elements assigned to each GPU worker or TPU core. The quality of the generated data is compared to Monte Carlo simulation. Linear speed up of the training process is obtained, while retaining most of the performance in terms of physics results. Additionally, we benchmark the aforementioned approaches, at scale, over multiple GPU nodes, deploying the training process on different public cloud providers, seeking for overall efficiency and cost effectiveness. The combination of data science, cloud deployment options and associated economics allows to burst out heterogeneously, exploring the full potential of cloud based services.


Free form Design of Discrete Architectural Surfaces by use of Circle Packing. This paper presents an efficient approach for the conceptual design of architectural surfaces which are composed of triangular panels. Given an initial design, the proposed method finds a triangulated surface with user specified Gaussian curvatures (not limited to constant Gaussian curvatures) while keeping some of the vertices fixed. In addition, the conformal class of the final design can be specified that is, the user has control over the shape (the corner angles) of each triangular panel. The panels could be encouraged to form a regular tessellation or kept close to those of the initial design. This allows the free form design of discrete architectural surfaces that achive curvature requirements posed by stiffness and constructability. Furthermore, controllability on the conformal class suppresses possible distortion of the panels, resulting in higher structural performance and aesthetics. Our method relies on the idea in discrete differential geometry called circle packing. In this line of research, the discrete Ricci flow has been widely used for surface modelling. However, it is not trivial to incorporate constraints such as boundary locations and convexity of the spanned surface, which are essential to architectural applications. Due to this difficulty, few concrete applications of the discrete Ricci flow have been reported which specifically aims at creation of architectural surfaces. We propose a perturbation of the discrete Ricci energy and develop a least squares based optimisation scheme to address these problems with a working implementation available online.


On the small time asymptotics of stochastic Ladyzhenskaya Smagorinsky equations with damping perturbed by multiplicative noise. The Ladyzhenskaya Smagorinsky equations model turbulence phenomena, and are given by frac partial boldsymbol u partial t mu mathrm div left( left(1 nabla boldsymbol u 2 right) frac p 2 2 nabla boldsymbol u right) ( boldsymbol u cdot nabla) boldsymbol u nabla p boldsymbol f , nabla cdot boldsymbol u 0, for p geq 2, in a bounded domain mathcal O subset mathbb R d ( 2 leq d leq 4 ). In this work, we consider the stochastic Ladyzhenskaya Smagorinsky equations with the damping alpha boldsymbol u beta boldsymbol u r 2 boldsymbol u , for r geq 2 ( alpha, beta geq 0 ), subjected to multiplicative Gaussian noise. We show the local monotoincity ( p geq frac d 2 1, r geq 2 ) as well as global monotonicity ( p geq 2, r geq 4 ) properties of the linear and nonlinear operators, which along with an application of stochastic version of Minty Browder technique imply the existence of a unique pathwise strong solution. Then, we discuss the small time asymptotics by studying the effect of small, highly nonlinear, unbounded drifts (small time large deviation principle) for the stochastic Ladyzhenskaya Smagorinsky equations with damping.


Properties of a curve whose convex hull covers a given convex body. In this note, we prove the following inequality for the norm of a convex body K in mathbb R n , n geq 2 N(K) leq frac pi frac n 1 2 2 Gamma left( frac n 1 2 right) cdot operatorname length ( gamma) frac pi frac n 2 1 Gamma left( frac n 2 right) cdot operatorname diam (K) , where operatorname diam (K) is the diameter of K , gamma is any curve in mathbb R n whose convex hull covers K , and Gamma is the gamma function. If in addition K has constant width Theta , then we get the inequality operatorname length ( gamma) geq frac 2( pi 1) Gamma left( frac n 1 2 right) sqrt pi , Gamma left( frac n 2 right) cdot Theta geq 2( pi 1) cdot sqrt frac n 1 2 pi cdot Theta . In addition, we pose several unsolved problems.


Optimal non pharmaceutical intervention policy for Covid 19 epidemic via neuroevolution algorithm. National responses to the Covid 19 pandemic varied markedly across countries, from business as usual to complete shutdowns. Policies aimed at disrupting the viral transmission cycle and preventing the healthcare system from being overwhelmed, simultaneously exact an economic toll. We developed a intervention policy model that comprised the relative human, economic and healthcare costs of non pharmaceutical epidemic intervention and arrived at the optimal strategy using the neuroevolution algorithm. The proposed model finds the minimum required reduction in contact rates to maintain the burden on the healthcare system below the maximum capacity. We find that such a policy renders a sharp increase in the control strength at the early stages of the epidemic, followed by a steady increase in the subsequent ten weeks as the epidemic approaches its peak, and finally control strength is gradually decreased as the population moves towards herd immunity. We have also shown how such a model can provide an efficient adaptive intervention policy at different stages of the epidemic without having access to the entire history of its progression in the population. This work emphasizes the importance of imposing intervention measures early and provides insights into adaptive intervention policies to minimize the economic impacts of the epidemic without putting an extra burden on the healthcare system.


Learning the Update Operator for 2D 3D Image Registration. Image guidance in minimally invasive interventions is usually provided using live 2D X ray imaging. To enhance the information available during the intervention, the preoperative volume can be overlaid over the 2D images using 2D 3D image registration. Recently, deep learning based 2D 3D registration methods have shown promising results by improving computational efficiency and robustness. However, there is still a gap in terms of registration accuracy compared to traditional optimization based methods. We aim to address this gap by incorporating traditional methods in deep neural networks using known operator learning. As an initial step in this direction, we propose to learn the update step of an iterative 2D 3D registration framework based on the Point to Plane Correspondence model. We embed the Point to Plane Correspondence model as a known operator in our deep neural network and learn the update step for the iterative registration. We show an improvement of 1.8 times in terms of registration accuracy for the update step prediction compared to learning without the known operator.


DPRK BERT The Supreme Language Model. Deep language models have achieved remarkable success in the NLP domain. The standard way to train a deep language model is to employ unsupervised learning from scratch on a large unlabeled corpus. However, such large corpora are only available for widely adopted and high resource languages and domains. This study presents the first deep language model, DPRK BERT, for the DPRK language. We achieve this by compiling the first unlabeled corpus for the DPRK language and fine tuning a preexisting the ROK language model. We compare the proposed model with existing approaches and show significant improvements on two DPRK datasets. We also present a cross lingual version of this model which yields better generalization across the two Korean languages. Finally, we provide various NLP tools related to the DPRK language that would foster future research.


Implementation of Sprouts a graph drawing game. Sprouts is a two player pencil and paper game invented by John Conway and Michael Paterson in 1967. In the game, the players take turns in joining dots by curves according to simple rules, until one player cannot make a move. The game of Sprouts is very popular and simple looking, so it may come as a surprise that there are essentially no AI Sprouts players available. This lack of computer opponents is caused by the fact that the game hides a surprisingly high combinatorial complexity and implementing it involves fascinating programming challenges. We overcome all the implementation barriers and create the first user friendly Sprouts application with a strong artificial intelligence after more than 50 years of the existence of the game. In particular, we combine results from the theory of nimbers with new methods based on Delaunay triangulations and crossing preserving force directed algorithms to develop an AI Sprouts player which plays a perfect game on up to 11 spots.


A note on 1 2 3 and 1 2 Conjectures for 3 regular graphs. The 1 2 3 Conjecture, posed by Karo ' n ski, L uczak and Thomason, asked whether every connected graph G different from K 2 can be 3 edge weighted so that every two adjacent vertices of G get distinct sums of incident weights. The 1 2 Conjecture states that if vertices also receive colors and the vertex color is added to the sum of its incident edges, then adjacent vertices can be distinguished using only 1,2 . In this paper we confirm 1 2 Conjecture for 3 regular graphs. Meanwhile, we show that every 3 regular graph can achieve a neighbor sum distinguishing edge coloring by using 4 colors, which answers 1 2 3 Conjecture positively.


Symbolic Knowledge Distillation from General Language Models to Commonsense Models. The common practice for training commonsense models has gone from human to corpus to machine humans author commonsense knowledge graphs in order to train commonsense models. In this work, we investigate an alternative, from machine to corpus to machine general language models author these commonsense knowledge graphs to train commonsense models. Our study leads to a new framework, Symbolic Knowledge Distillation. As with prior art in Knowledge Distillation (Hinton et al., 2015), our approach uses larger models to teach smaller models. A key difference is that we distill knowledge symbolically as text in addition to the neural model. We also distill only one aspect the commonsense of a general language model teacher, allowing the student to be a different type, a commonsense model. Altogether, we show that careful prompt engineering and a separately trained critic model allow us to selectively distill high quality causal commonsense from GPT 3, a general language model. Empirical results demonstrate that, for the first time, a human authored commonsense knowledge graph is surpassed by our automatically distilled variant in all three criteria quantity, quality, and diversity. In addition, it results in a neural commonsense model that surpasses the teacher model's commonsense capabilities despite its 100x smaller size. We apply this to the ATOMIC resource, and share our new symbolic knowledge graph and commonsense models.


Privacy preserving Federated Learning based on Multi key Homomorphic Encryption. With the advance of machine learning and the internet of things (IoT), security and privacy have become key concerns in mobile services and networks. Transferring data to a central unit violates privacy as well as protection of sensitive data while increasing bandwidth demands.Federated learning mitigates this need to transfer local data by sharing model updates only. However, data leakage still remains an issue. In this paper, we propose xMK CKKS, a multi key homomorphic encryption protocol to design a novel privacy preserving federated learning scheme. In this scheme, model updates are encrypted via an aggregated public key before sharing with a server for aggregation. For decryption, collaboration between all participating devices is required. This scheme prevents privacy leakage from publicly shared information in federated learning, and is robust to collusion between k N 1 participating devices and the server. Our experimental evaluation demonstrates that the scheme preserves model accuracy against traditional federated learning as well as secure federated learning with homomorphic encryption (MK CKKS, Paillier) and reduces computational cost compared to Paillier based federated learning. The average energy consumption is 2.4 Watts, so that it is suited to IoT scenarios.


Political districting without geography. Geographical considerations such as contiguity and compactness are necessary elements of political districting in practice. Yet an analysis of the problem without such constraints yields mathematical insights that can inform real world model construction. In particular, it clarifies the sharp contrast between proportionality and competitiveness and how it might be overcome in a properly formulated objective function. It also reveals serious weaknesses of the much discussed efficiency gap as a criterion for gerrymandering.


Asymptotic analysis of a thin fluid layer flow between two moving surfaces. In this paper we study the behavior of an incompressible viscous fluid moving between two very close surfaces also in motion. Using the asymptotic expansion method we formally justify two models, a lubrication model and a shallow water model, depending on the boundary conditions imposed. Finally, we discuss under what conditions each of the models would be applicable.


Neural Medication Extraction A Comparison of Recent Models in Supervised and Semi supervised Learning Settings. Drug prescriptions are essential information that must be encoded in electronic medical records. However, much of this information is hidden within free text reports. This is why the medication extraction task has emerged. To date, most of the research effort has focused on small amount of data and has only recently considered deep learning methods. In this paper, we present an independent and comprehensive evaluation of state of the art neural architectures on the I2B2 medical prescription extraction task both in the supervised and semi supervised settings. The study shows the very competitive performance of simple DNN models on the task as well as the high interest of pre trained models. Adapting the latter models on the I2B2 dataset enables to push medication extraction performances above the state of the art. Finally, the study also confirms that semi supervised techniques are promising to leverage large amounts of unlabeled data in particular in low resource setting when labeled data is too costly to acquire.


Random Walk Models for Nontrivial Identities of Bernoulli and Euler Polynomials. We consider the 1 dimensional reflected Brownian motion and 3 dimensional Bessel process and the general models. By decomposing the hitting times of consecutive sites into loops, we obtain identities, called loop identities, for the generating functions of the hitting times. After proving this decomposition both combinatorially and inductively, we consider the case that sites are equally distributed. Then, from loop identities, we derive expressions of Bernoulli and Euler polynomials, in terms of Euler polynomials of higher orders.


Philippe Flajolet's early work in combinatorics. Some of Philippe Flajolet's combinatorial contributions that he wrote between 1976 and 1995, say, are described. In most of Flajolet's papers, asymptotic analytic considerations play a major role. To be true to the spirit of the journal ECA, the emphasis is on the emph combinatorial part. Covered are Register function of binary trees, approximate counting, digital search trees and the Rice formula, probabilistic counting, adding a new slice, Ramanujan's influence, finite differences and harmonic numbers, Digits and the Mellin Perron formula.