A Novel Generator with Auxiliary Branch for Improving GAN Performance. The generator in the generative adversarial network (GAN) learns image generation in a coarse to fine manner in which earlier layers learn an overall structure of the image and the latter ones refine the details. To propagate the coarse information well, recent works usually build their generators by stacking up multiple residual blocks. Although the residual block can produce the high quality image as well as be trained stably, it often impedes the information flow in the network. To alleviate this problem, this brief introduces a novel generator architecture that produces the image by combining features obtained through two different branches the main and auxiliary branches. The goal of the main branch is to produce the image by passing through the multiple residual blocks, whereas the auxiliary branch is to convey the coarse information in the earlier layer to the later one. To combine the features in the main and auxiliary branches successfully, we also propose a gated feature fusion module that controls the information flow in those branches. To prove the superiority of the proposed method, this brief provides extensive experiments using various standard datasets including CIFAR 10, CIFAR 100, LSUN, CelebA HQ, AFHQ, and tiny ImageNet. Furthermore, we conducted various ablation studies to demonstrate the generalization ability of the proposed method. Quantitative evaluations prove that the proposed method exhibits impressive GAN performance in terms of Inception score (IS) and Frechet inception distance (FID). For instance, the proposed method boosts the FID and IS scores on the tiny ImageNet dataset from 35.13 to 25.00 and 20.23 to 25.57, respectively.


Pedagogical Justifications That Zero Factorial Equals One Making Data Driven Instructional Choices in Education. Zero factorial, defined to be one, is often counterintuitive to students but nonetheless an interesting concept to convey in a classroom environment. The challenge is to delineate the concept in a simple and effective way. In this regard, the contribution of this article is two fold First, it reveals and makes contribution to much simpler justifications on the notion of zero factorial to be one when compared to previous studies in the area. Second, to assess the effectiveness of the proposed justifications, an online survey has been conducted at a comprehensive university and, via its statistical analysis, data driven instructional decision making has been illustrated. Elaborating on the first contribution, we note that the connection of zero factorial to the definition of the gamma function provides a first hand conceptual understanding of the concept of zero factorial. But for the purpose of teaching, it is not particularly helpful from the pedagogical point of view in early years of study, as it is quite challenging to explain the rationale behind the origin of the definite integral that defines the gamma function. In this regard two algebraic and one statistical justification are presented. The squeeze theorem plays a pivotal role in this article. To assess the effectiveness of the justifications pedagogically, an online survey was conducted at a Canadian university.


Dependable IoT Data Stream Processing for Monitoring and Control of Urban Infrastructures. The Internet of Things describes a network of physical devices interacting and producing vast streams of sensor data. At present there are a number of general challenges which exist while developing solutions for use cases involving the monitoring and control of urban infrastructures. These include the need for a dependable method for extracting value from these high volume streams of time sensitive data which is adaptive to changing workloads. Low latency access to the current state for live monitoring is a necessity as well as the ability to perform queries on historical data. At the same time, many design choices need to be made and the number of possible technology options available further adds to the complexity. In this paper we present a dependable IoT data processing platform for the monitoring and control of urban infrastructures. We define requirements in terms of dependability and then select a number of mature open source technologies to match these requirements. We examine the disparate parts necessary for delivering a holistic overall architecture and describe the dataflows between each of these components. We likewise present generalizable methods for the enrichment and analysis of sensor data applicable across various application areas. We demonstrate the usefulness of this approach by providing an exemplary prototype platform executing on top of Kubernetes and evaluate the effectiveness of jobs processing sensor data in this environment.


Hilbert schemes of K3 surfaces, generalized Kummer, and cobordism classes of hyper K "ahler manifolds. We prove that the complex cobordism class of any hyper K " a hler manifold of dimension 2n is a unique combination with rational coefficients of classes of products of punctual Hilbert schemes of K3 surfaces. We also prove a similar result using the generalized Kummer varieties instead of punctual Hilbert schemes. As a key step, we establish a closed formula for the top Chern character of their tangent bundles.


Construction of Continuous Magnetic Cooling Apparatus with Zinc Soldered PrNi 5 Nuclear Stages. We report design details of the whole assembly of a compact and continuous nuclear demagnetization refrigerator (CNDR) with two PrNi 5 nuclear stages, which can keep temperature below 1 mK continuously, and test results of a new thermal contact method for the PrNi 5 stage using Zn soldering rather than Cd soldering. By measuring a residual electrical resistance of a short test piece, the thermal contact resistivity between the PrNi 5 rod and an Ag wires thermal link was estimated as 1.8 pm0.1 times 10 4 T 1 rm Km 2W 1 . Based on this value and 2D numerical and 1D analytical thermal simulations, the largest possible temperature gradient throughout the nuclear stage was calculated to be negligibly small ( leq 2 ) at 1 mK under a 10 nW heat leak, the expected cooling power of the CNDR.


Object Augmented RGB D SLAM for Wide Disparity Relocalisation. We propose a novel object augmented RGB D SLAM system that is capable of constructing a consistent object map and performing relocalisation based on centroids of objects in the map. The approach aims to overcome the view dependence of appearance based relocalisation methods using point features or images. During the map construction, we use a pre trained neural network to detect objects and estimate 6D poses from RGB D data. An incremental probabilistic model is used to aggregate estimates over time to create the object map. Then in relocalisation, we use the same network to extract objects of interest in the lost' frames. Pairwise geometric matching finds correspondences between map and frame objects, and probabilistic absolute orientation followed by application of iterative closest point to dense depth maps and object centroids gives relocalisation. Results of experiments in desktop environments demonstrate very high success rates even for frames with widely different viewpoints from those used to construct the map, significantly outperforming two appearance based methods.


Optimization of robustness based on reinforced nodes in a modular network. Many systems such as critical infrastructure exhibit a modular structure with many links within the modules and few links between them. One approach to increase the robustness of these systems is to reinforce a fraction of the nodes in each module, so that the reinforced nodes provide additional needed sources for themselves as well as for their nearby neighborhood. Since reinforcing a node can be an expensive task, the efficiency of the decentralization process by reinforced nodes is vital. In our study we analyze a new model which combines both above mentioned features of real complex systems modularity and reinforced nodes. Using tools from percolation theory, we derived an analytical solution for any partition of reinforced nodes between nodes which have links that connect them to other modules ("inter nodes") and nodes which have connections only within their modules ("intra nodes"). Among our results, we find that near the critical percolation point ( p approx p c ) the robustness is greatly affected by the distribution. In particular, we find a partition of reinforced nodes which yields an optimal robustness and we show that the optimal partition remains constant for high average degrees.


Extracting Attentive Social Temporal Excitation for Sequential Recommendation. In collaborative filtering, it is an important way to make full use of social information to improve the recommendation quality, which has been proved to be effective because user behavior will be affected by her friends. However, existing works leverage the social relationship to aggregate user features from friends' historical behavior sequences in a user level indirect paradigm. A significant defect of the indirect paradigm is that it ignores the temporal relationships between behavior events across users. In this paper, we propose a novel time aware sequential recommendation framework called Social Temporal Excitation Networks (STEN), which introduces temporal point processes to model the fine grained impact of friends' behaviors on the user s dynamic interests in an event level direct paradigm. Moreover, we propose to decompose the temporal effect in sequential recommendation into social mutual temporal effect and ego temporal effect. Specifically, we employ a social heterogeneous graph embedding layer to refine user representation via structural information. To enhance temporal information propagation, STEN directly extracts the fine grained temporal mutual influence of friends' behaviors through the mutually exciting temporal network. Besides, the user s dynamic interests are captured through the self exciting temporal network. Extensive experiments on three real world datasets show that STEN outperforms state of the art baseline methods. Moreover, STEN provides event level recommendation explainability, which is also illustrated experimentally.


Solid locally analytic representations of p adic Lie groups. We develop the theory of locally analytic representations of compact p adic Lie groups from the perspective of the theory of condensed mathematics of Clausen and Scholze. As an application, we generalise Lazard's isomorphisms between continuous, locally analytic and Lie algebra cohomology to solid representations. We also prove a comparison result between the group cohomology of a solid representation and of its analytic vectors.


Evaluating the Robustness of Deep Reinforcement Learning for Autonomous and Adversarial Policies in a Multi agent Urban Driving Environment. Deep reinforcement learning is actively used for training autonomous driving agents in a vision based urban simulated environment. Due to the large availability of various reinforcement learning algorithms, we are still unsure of which one works better while training autonomous cars in single agent as well as multi agent driving environments. A comparison of deep reinforcement learning in vision based autonomous driving will open up the possibilities for training better autonomous car policies. Also, autonomous cars trained on deep reinforcement learning based algorithms are known for being vulnerable to adversarial attacks, and we have less information on which algorithms would act as a good adversarial agent. In this work, we provide a systematic evaluation and comparative analysis of 6 deep reinforcement learning algorithms for autonomous and adversarial driving in four way intersection scenario. Specifically, we first train autonomous cars using state of the art deep reinforcement learning algorithms. Second, we test driving capabilities of the trained autonomous policies in single agent as well as multi agent scenarios. Lastly, we use the same deep reinforcement learning algorithms to train adversarial driving agents, in order to test the driving performance of autonomous cars and look for possible collision and offroad driving scenarios. We perform experiments by using vision only high fidelity urban driving simulated environments.


Gradients and Subgradients of Buffered Failure Probability. Gradients and subgradients are central to optimization and sensitivity analysis of buffered failure probabilities. We furnish a characterization of subgradients based on subdifferential calculus in the case of finite probability distributions and, under additional assumptions, also a gradient expression for general distributions. Several examples illustrate the application of the results, especially in the context of optimality conditions.


Toposes of Monoid Actions. We study toposes of actions of monoids on sets. We begin with ordinary actions, producing a class of presheaf toposes which we characterize. As groundwork for considering topological monoids, we branch out into a study of supercompactly generated toposes (a class strictly larger than presheaf toposes). This enables us to efficiently study and characterize toposes of continuous actions of topological monoids on sets, where the latter are viewed as discrete spaces. Finally, we refine this characterization into necessary and sufficient conditions for a supercompactly generated topos to be equivalent to a topos of this form.


Khaos Dynamically Optimizing Checkpointing for Dependable Distributed Stream Processing. Distributed Stream Processing systems are becoming an increasingly essential part of Big Data processing platforms as users grow ever more reliant on their ability to provide fast access to new results. As such, making timely decisions based on these results is dependent on a system's ability to tolerate failure. Typically, these systems achieve fault tolerance and the ability to recover automatically from partial failures by implementing checkpoint and rollback recovery. However, owing to the statistical probability of partial failures occurring in these distributed environments and the variability of workloads upon which jobs are expected to operate, static configurations will often not meet Quality of Service constraints with low overhead. In this paper we present Khaos, a new approach which utilizes the parallel processing capabilities of virtual cloud automation technologies for the automatic runtime optimization of fault tolerance configurations in Distributed Stream Processing jobs. Our approach employs three subsequent phases which borrows from the principles of Chaos Engineering establish the steady state processing conditions, conduct experiments to better understand how the system performs under failure, and use this knowledge to continuously minimize Quality of Service violations. We implemented Khaos prototypically together with Apache Flink and demonstrate its usefulness experimentally.


Parameterized splitting theorems and bifurcations for potential operators, Part I Abstract theory. This is the first part of a series devoting to the generalizations and applications of common theorems in variational bifurcation theory. Using parameterized versions of splitting theorems in Morse theory we generalize some famous bifurcation theorems for potential operators by weakening standard assumptions on the differentiability of the involved functionals, which opens up a way of bifurcation studies for quasi linear elliptic boundary value problems.


The Kakeya Set Conjecture for mathbb Z N mathbb Z for general N . We prove the Kakeya set conjecture for mathbb Z N mathbb Z for general N as stated by Hickman and Wright HW18 . This entails extending and combining the techniques of Arsovski Ars21a for N p k and the author and Dvir DD21 for the case of square free N . We also prove stronger lower bounds for the size of (m, epsilon) Kakeya sets over mathbb Z p k mathbb Z by extending the techniques of Ars21a using multiplicities as was done in SS08, DKSS13 . In addition, we show our bounds are almost sharp by providing a new construction for Kakeya sets over mathbb Z p k mathbb Z and mathbb Z N mathbb Z .


Adversarial Training of Variational Auto encoders for Continual Zero shot Learning(A CZSL). Most of the existing artificial neural networks(ANNs) fail to learn continually due to catastrophic forgetting, while humans can do the same by maintaining previous tasks' performances. Although storing all the previous data can alleviate the problem, it takes a large memory, infeasible in real world utilization. We propose a continual zero shot learning model(A CZSL) that is more suitable in real case scenarios to address the issue that can learn sequentially and distinguish classes the model has not seen during training. Further, to enhance the reliability, we develop A CZSL for a single head continual learning setting where task identity is revealed during the training process but not during the testing. We present a hybrid network that consists of a shared VAE module to hold information of all tasks and task specific private VAE modules for each task. The model's size grows with each task to prevent catastrophic forgetting of task specific skills, and it includes a replay approach to preserve shared skills. We demonstrate our hybrid model outperforms the baselines and is effective on several datasets, i.e., CUB, AWA1, AWA2, and aPY. We show our method is superior in class sequentially learning with ZSL(Zero Shot Learning) and GZSL(Generalized Zero Shot Learning).


One Round Active Learning. In this work, we initiate the study of one round active learning, which aims to select a subset of unlabeled data points that achieve the highest model performance after being labeled with only the information from initially labeled data points. The challenge of directly applying existing data selection criteria to the one round setting is that they are not indicative of model performance when available labeled data is limited. We address the challenge by explicitly modeling the dependence of model performance on the dataset. Specifically, we propose DULO, a data driven framework for one round active learning, wherein we learn a model to predict the model performance for a given dataset and then leverage this model to guide the selection of unlabeled data. Our results demonstrate that DULO leads to the state of the art performance on various active learning benchmarks in the one round setting.


A characterization of a local vector valued Bollob 'as theorem. In this paper, we are interested in giving two characterizations for the so called property bf L o,o , a local vector valued Bollob 'as type theorem. We say that (X, Y) has this property whenever given eps 0 and an operador T X rightarrow Y , there is eta eta( eps, T) such that if x satisfies T(x) 1 eta , then there exists x 0 in S X such that x 0 approx x and T itself attains its norm at x 0 . This can be seen as a strong (although local) Bollob 'as theorem for operators. We prove that the pair (X, Y) has the bf L o,o for compact operators if and only if so does (X, K) for linear functionals. This generalizes at once some results due to D. Sain and J. Talponen. Moreover, we present a complete characterization for when (X pten Y, K) satisfies the bf L o,o for linear functionals under strict convexity or Kadec Klee property assumptions in one of the spaces. As a consequence, we generalize some results in the literature related to the strongly subdifferentiability of the projective tensor product and show that (L p( mu) times L q( nu) K) cannot satisfy the bf L o,o for bilinear forms.


Variance of Twitter Embeddings and Temporal Trends of COVID 19 cases. The severity of the coronavirus pandemic necessitates the need of effective administrative decisions. Over 4 lakh people in India succumbed to COVID 19, with over 3 crore confirmed cases, and still counting. The threat of a plausible third wave continues to haunt millions. In this ever changing dynamic of the virus, predictive modeling methods can serve as an integral tool. The pandemic has further triggered an unprecedented usage of social media. This paper aims to propose a method for harnessing social media, specifically Twitter, to predict the upcoming scenarios related to COVID 19 cases. In this study, we seek to understand how the surges in COVID 19 related tweets can indicate rise in the cases. This prospective analysis can be utilised to aid administrators about timely resource allocation to lessen the severity of the damage. Using word embeddings to capture the semantic meaning of tweets, we identify Significant Dimensions (SDs).Our methodology predicts the rise in cases with a lead time of 15 days and 30 days with R2 scores of 0.80 and 0.62 respectively. Finally, we explain the thematic utility of the SDs.


Doubt and Redundancy Kill Soft Errors Towards Detection and Correction of Silent Data Corruption in Task based Numerical Software. Resilient algorithms in high performance computing are subject to rigorous non functional constraints. Resiliency must not increase the runtime, memory footprint or I O demands too significantly. We propose a task based soft error detection scheme that relies on error criteria per task outcome. They formalise how dubious'' an outcome is, i.e. how likely it contains an error. Our whole simulation is replicated once, forming two teams of MPI ranks that share their task results. Thus, ideally each team handles only around half of the workload. If a task yields large error criteria values, i.e. is dubious, we compute the task redundantly and compare the outcomes. Whenever they disagree, the task result with a lower error likeliness is accepted. We obtain a self healing, resilient algorithm which can compensate silent floating point errors without a significant performance, I O or memory footprint penalty. Case studies however suggest that a careful, domain specific tailoring of the error criteria remains essential.


A spectral condition for the existence of C 2k 1 in non bipartite graphs. A graph G is H free, if it contains no subgraph isomorphic to H . In 2010, Nikiforov proposed a Brualdi Solheid Tur ' a n type problem what is the maximum spectral radius of an H free graph of order n ? Guo, Lin and Zhao proved a Brualdi Solheid Tur ' a n type problem on non bipartite graphs for pentagon. In this paper, we study that if G is a non bipartite graph with sufficiently large order n and rho(G) geq rho(K lceil frac n 2 2 rceil, lfloor frac n 2 2 rfloor bullet K 3) , then G contains a C 2k 1 unless G cong K lceil frac n 2 2 rceil, lfloor frac n 2 2 rfloor bullet K 3 , where K a, b bullet K 3 is the graph obtained by identifying a vertex of K a,b belonging to the part of size b and a vertex of K 3 .


Are socially aware trajectory prediction models really socially aware?. Our field has recently witnessed an arms race of neural network based trajectory predictors. While these predictors are at the core of many applications such as autonomous navigation or pedestrian flow simulations, their adversarial robustness has not been carefully studied. In this paper, we introduce a socially attended attack to assess the social understanding of prediction models in terms of collision avoidance. An attack is a small yet carefully crafted perturbations to fail predictors. Technically, we define collision as a failure mode of the output, and propose hard and soft attention mechanisms to guide our attack. Thanks to our attack, we shed light on the limitations of the current models in terms of their social understanding. We demonstrate the strengths of our method on the recent trajectory prediction models. Finally, we show that our attack can be employed to increase the social understanding of state of the art models. The code is available online https s attack.github.io


Permutohedral complexes and rational curves with cyclic action. We define a moduli space of rational curves with finite order automorphism and weighted orbits, and we prove that the combinatorics of its boundary strata are encoded by a particular polytopal complex that also captures the algebraic structure of a complex reflection group acting on the moduli space. This generalizes the situation for Losev Manin's moduli space of curves (whose boundary strata are encoded by the permutohedron and related to the symmetric group) as well as the situation for Batyrev Blume's moduli space of curves with involution, and it extends that work beyond the toric context.


On the existence of finite surjective parametrizations of affine surfaces. We investigate surjective parametrizations of rational algebraic varieties, in the vein of recent work by Jorge Caravantes, J. Rafael Sendra, David Sevilla, and Carlos Villarino. In particular, we show how to construct plenty of examples of affine surfaces S not admitting a finite surjective morphism f mathbb A 2 to S .


Many Joint Robot Arm Control with Recurrent Spiking Neural Networks. In the paper, we show how scalable, low cost trunk like robotic arms can be constructed using only basic 3D printing equipment and simple electronics. The design is based on uniform, stackable joint modules with three degrees of freedom each. Moreover, we present an approach for controlling these robots with recurrent spiking neural networks. At first, a spiking forward model learns motor pose correlations from movement observations. After training, intentions can be projected back through unrolled spike trains of the forward model essentially routing the intention driven motor gradients towards the respective joints, which unfolds goal direction navigation. We demonstrate that spiking neural networks can thus effectively control trunk like robotic arms with up to 75 articulated degrees of freedom with near millimeter accuracy.


On Bounded Finite Potent Operators on arbitrary Hilbert Spaces. The aim of this work is to study the structure of bounded finite potent endomorphisms on Hilbert spaces. In particular, for these operators, an answer to the Invariant Subspace Problem is given and the main properties of its adjoint operator are offered. Moreover, for every bounded finite potent endomorphism we show that Tate's trace coincides with the Leray trace and with the trace defined by R. Elliott for Riesz Trace Class operators.


When is Early Classification of Time Series Meaningful?. Since its introduction two decades ago, there has been increasing interest in the problem of early classification of time series. This problem generalizes classic time series classification to ask if we can classify a time series subsequence with sufficient accuracy and confidence after seeing only some prefix of a target pattern. The idea is that the earlier classification would allow us to take immediate action, in a domain in which some practical interventions are possible. For example, that intervention might be sounding an alarm or applying the brakes in an automobile. In this work, we make a surprising claim. In spite of the fact that there are dozens of papers on early classification of time series, it is not clear that any of them could ever work in a real world setting. The problem is not with the algorithms per se but with the vague and underspecified problem description. Essentially all algorithms make implicit and unwarranted assumptions about the problem that will ensure that they will be plagued by false positives and false negatives even if their results suggested that they could obtain near perfect results. We will explain our findings with novel insights and experiments and offer recommendations to the community.


Meaningful human control over AI systems beyond talking the talk. The concept of meaningful human control has been proposed to address responsibility gaps and mitigate them by establishing conditions that enable a proper attribution of responsibility for humans (e.g., users, designers and developers, manufacturers, legislators). However, the relevant discussions around meaningful human control have so far not resulted in clear requirements for researchers, designers, and engineers. As a result, there is no consensus on how to assess whether a designed AI system is under meaningful human control, making the practical development of AI based systems that remain under meaningful human control challenging. In this paper, we address the gap between philosophical theory and engineering practice by identifying four actionable properties which AI based systems must have to be under meaningful human control. First, a system in which humans and AI algorithms interact should have an explicitly defined domain of morally loaded situations within which the system ought to operate. Second, humans and AI agents within the system should have appropriate and mutually compatible representations. Third, responsibility attributed to a human should be commensurate with that human's ability and authority to control the system. Fourth, there should be explicit links between the actions of the AI agents and actions of humans who are aware of their moral responsibility. We argue these four properties are necessary for AI systems under meaningful human control, and provide possible directions to incorporate them into practice. We illustrate these properties with two use cases, automated vehicle and AI based hiring. We believe these four properties will support practically minded professionals to take concrete steps toward designing and engineering for AI systems that facilitate meaningful human control and responsibility.


Generating abstractive summaries of Lithuanian news articles using a transformer model. In this work, we train the first monolingual Lithuanian transformer model on a relatively large corpus of Lithuanian news articles and compare various output decoding algorithms for abstractive news summarization. We achieve an average ROUGE 2 score 0.163, generated summaries are coherent and look impressive at first glance. However, some of them contain misleading information that is not so easy to spot. We describe all the technical details and share our trained model and accompanying code in an online open source repository, as well as some characteristic samples of the generated summaries.


Topological Receptive Field Model for Human Retinotopic Mapping. The mapping between visual inputs on the retina and neuronal activations in the visual cortex, i.e., retinotopic map, is an essential topic in vision science and neuroscience. Human retinotopic maps can be revealed by analyzing the functional magnetic resonance imaging (fMRI) signal responses to designed visual stimuli in vivo. Neurophysiology studies summarized that visual areas are topological (i.e., nearby neurons have receptive fields at nearby locations in the image). However, conventional fMRI based analyses frequently generate non topological results because they process fMRI signals on a voxel wise basis, without considering the neighbor relations on the surface. Here we propose a topological receptive field (tRF) model which imposes the topological condition when decoding retinotopic fMRI signals. More specifically, we parametrized the cortical surface to a unit disk, characterized the topological condition by tRF, and employed an efficient scheme to solve the tRF model. We tested our framework on both synthetic and human fMRI data. Experimental results showed that the tRF model could remove the topological violations, improve model explaining power, and generate biologically plausible retinotopic maps. The proposed framework is general and can be applied to other sensory maps.


Hilbert's Irreducibility Theorem and Ideal Class Groups of Quadratic Fields. We prove a version of Hilbert's Irreducibility Theorem in the quadratic case, giving a quantitative improvement to a result of Bilu Gillibert in this restricted setting. As an application, we give improvements to several quantitative results counting quadratic fields with certain types of ideal class groups. The proof of the main theorem is based on a result of Stewart and Top on values of binary forms modulo squares.


Integrating Deep Learning and Augmented Reality to Enhance Situational Awareness in Firefighting Environments. We present a new four pronged approach to build firefighter's situational awareness for the first time in the literature. We construct a series of deep learning frameworks built on top of one another to enhance the safety, efficiency, and successful completion of rescue missions conducted by firefighters in emergency first response settings. First, we used a deep Convolutional Neural Network (CNN) system to classify and identify objects of interest from thermal imagery in real time. Next, we extended this CNN framework for object detection, tracking, segmentation with a Mask RCNN framework, and scene description with a multimodal natural language processing(NLP) framework. Third, we built a deep Q learning based agent, immune to stress induced disorientation and anxiety, capable of making clear navigation decisions based on the observed and stored facts in live fire environments. Finally, we used a low computational unsupervised learning technique called tensor decomposition to perform meaningful feature extraction for anomaly detection in real time. With these ad hoc deep learning structures, we built the artificial intelligence system's backbone for firefighters' situational awareness. To bring the designed system into usage by firefighters, we designed a physical structure where the processed results are used as inputs in the creation of an augmented reality capable of advising firefighters of their location and key features around them, which are vital to the rescue operation at hand, as well as a path planning feature that acts as a virtual guide to assist disoriented first responders in getting back to safety. When combined, these four approaches present a novel approach to information understanding, transfer, and synthesis that could dramatically improve firefighter response and efficacy and reduce life loss.


SLOSH Set LOcality Sensitive Hashing via Sliced Wasserstein Embeddings. Learning from set structured data is an essential problem with many applications in machine learning and computer vision. This paper focuses on non parametric and data independent learning from set structured data using approximate nearest neighbor (ANN) solutions, particularly locality sensitive hashing. We consider the problem of set retrieval from an input set query. Such retrieval problem requires 1) an efficient mechanism to calculate the distances dissimilarities between sets, and 2) an appropriate data structure for fast nearest neighbor search. To that end, we propose Sliced Wasserstein set embedding as a computationally efficient "set 2 vector" mechanism that enables downstream ANN, with theoretical guarantees. The set elements are treated as samples from an unknown underlying distribution, and the Sliced Wasserstein distance is used to compare sets. We demonstrate the effectiveness of our algorithm, denoted as Set LOcality Sensitive Hashing (SLOSH), on various set retrieval datasets and compare our proposed embedding with standard set embedding approaches, including Generalized Mean (GeM) embedding pooling, Featurewise Sort Pooling (FSPool), and Covariance Pooling and show consistent improvement in retrieval results. The code for replicating our results is available here href https github.com mint vu SLOSH https github.com mint vu SLOSH .


Hopfian and co Hopfian modules over Artinian rings. An R module M is Hopfian (co Hopfian) if any epic (monic) endomorphism of M is an automorphism. If R is commutative Noetherian, we characterize the co Hopfian injective R modules, and the Hopfian injectives in the case that R is also reduced. For a commutative Artinian principal ideal ring, we show that M is Hopfian (co Hopfian) if and only if M is finitely generated if and only if its injective envelope E(M) is Hopfian (co Hopfian) if and only if E(M) is finitely generated. We identify the obstacle to generalizing this result to arbitrary Artinian principal ideal rings.


A universal state sum. We define a universal state sum construction which specializes to most previously known state sums (Turaev Viro, Dijkgraaf Witten, Crane Yetter, Douglas Reutter, Witten Reshetikhin Turaev surgery formula, Brown Arf). The input data for the state sum is an n category satisfying various conditions, including finiteness, semisimplicity and n pivotality. From this n category one constructs an n 1 dimensional TQFT, and applying the TQFT gluing rules to a handle decomposition of an n 1 manifold produces the state sum.


Faster Convergence in Multi Objective Optimization Algorithms Based on Decomposition. The Resource Allocation approach (RA) improves the performance of MOEA D by maintaining a big population and updating few solutions each generation. However, most of the studies on RA generally focused on the properties of different Resource Allocation metrics. Thus, it is still uncertain what the main factors are that lead to increments in performance of MOEA D with RA. This study investigates the effects of MOEA D with the Partial Update Strategy in an extensive set of MOPs to generate insights into correspondences of MOEA D with the Partial Update and MOEA D with small population size and big population size. Our work undertakes an in depth analysis of the populational dynamics behaviour considering their final approximation Pareto sets, anytime hypervolume performance, attained regions and number of unique non dominated solutions. Our results indicate that MOEA D with Partial Update progresses with the search as fast as MOEA D with small population size and explores the search space as MOEA D with big population size. MOEA D with Partial Update can mitigate common problems related to population size choice with better convergence speed in most MOPs, as shown by the results of hypervolume and number of unique non dominated solutions, the anytime performance and Empirical Attainment Function indicates.


Detecting and Tracking Small and Dense Moving Objects in Satellite Videos A Benchmark. Satellite video cameras can provide continuous observation for a large scale area, which is important for many remote sensing applications. However, achieving moving object detection and tracking in satellite videos remains challenging due to the insufficient appearance information of objects and lack of high quality datasets. In this paper, we first build a large scale satellite video dataset with rich annotations for the task of moving object detection and tracking. This dataset is collected by the Jilin 1 satellite constellation and composed of 47 high quality videos with 1,646,038 instances of interest for object detection and 3,711 trajectories for object tracking. We then introduce a motion modeling baseline to improve the detection rate and reduce false alarms based on accumulative multi frame differencing and robust matrix completion. Finally, we establish the first public benchmark for moving object detection and tracking in satellite videos, and extensively evaluate the performance of several representative approaches on our dataset. Comprehensive experimental analyses and insightful conclusions are also provided. The dataset is available at https github.com QingyongHu VISO.


A Distributed Gradient Approach for System Optimal Dynamic Traffic Assignment. This study presents a distributed gradient based approach to solve system optimal dynamic traffic assignment (SODTA) formulated based on the cell transmission model. The algorithm distributes SODTA into local sub problems, who find optimal values for their decision variables within an intersection. Each sub problem communicates with its immediate neighbors to reach a consensus on the values of common decision variables. A sub problem receives proposed values for common decision variables from all adjacent sub problems and incorporates them into its own offered values by weighted averaging and enforcing a gradient step to minimize its objective function. Then, the updated values are projected onto the feasible region of the sub problems. The algorithm finds high quality solutions in all tested scenarios with a finite number of iterations. The algorithm is tested on a case study network under different demand levels and finds solutions with at most a 5 optimality gap.


Probabilistic Visual Place Recognition for Hierarchical Localization. Visual localization techniques often comprise a hierarchical localization pipeline, with a visual place recognition module used as a coarse localizer to initialize a pose refinement stage. While improving the pose refinement step has been the focus of much recent research, most work on the coarse localization stage has focused on improvements like increased invariance to appearance change, without improving what can be loose error tolerances. In this letter, we propose two methods which adapt image retrieval techniques used for visual place recognition to the Bayesian state estimation formulation for localization. We demonstrate significant improvements to the localization accuracy of the coarse localization stage using our methods, whilst retaining state of the art performance under severe appearance change. Using extensive experimentation on the Oxford RobotCar dataset, results show that our approach outperforms comparable state of the art methods in terms of precision recall performance for localizing image sequences. In addition, our proposed methods provides the flexibility to contextually scale localization latency in order to achieve these improvements. The improved initial localization estimate opens up the possibility of both improved overall localization performance and modified pose refinement techniques that leverage this improved spatial prior.


Certifying Numerical Decompositions of Compact Group Representations. We present a performant and rigorous algorithm for certifying that a matrix is close to being a projection onto an irreducible subspace of a given group representation. This addresses a problem arising when one seeks solutions to semi definite programs (SDPs) with a group symmetry. Indeed, in this context, the dimension of the SDP can be significantly reduced if the irreducible representations of the group action are explicitly known. Rigorous numerical algorithms for decomposing a given group representation into irreps are known, but fairly expensive. To avoid this performance problem, existing software packages e.g. RepLAB, which motivated the present work use randomized heuristics. While these seem to work well in practice, the problem of to which extent the results can be trusted arises. Here, we provide rigorous guarantees applicable to finite and compact groups, as well as a software implementation that can interface with RepLAB. Under natural assumptions, a commonly used previous method due to Babai and Friedl runs in time O(n 5) for n dimensional representations. In our approach, the complexity of running both the heuristic decomposition and the certification step is O(max n 3 log n, D d 2 log d ), where d is the maximum dimension of an irreducible subrepresentation, and D is the time required to multiply elements of the group. A reference implementation interfacing with RepLAB is provided.


Ramsey numbers for complete graphs versus generalized fans. For two graphs G and H , let r(G,H) and r (G,H) denote the Ramsey number and star critical Ramsey number of G versus H , respectively. In 1996, Li and Rousseau proved that r(K m ,F t,n ) tn(m 1) 1 for m geq 3 and sufficiently large n , where F t,n K 1 nK t . Recently, Hao and Lin proved that r(K 3 ,F 3,n ) 6n 1 for n geq 3 and r ast (K 3 ,F 3,n ) 3n 3 for n geq 4 . In this paper, we show that r(K m , sF t,n ) tn(m s 2) s for sufficiently large n and, in particular, r(K 3 , sF t,n ) tn(s 1) s for t in 3,4 ,n geq t and s geq1 . We also show that r ast (K 3 , F 4,n ) 4n 4 for n geq 4 and establish an upper bound on r(F 2,m ,F t,n ) .


indicnlp kgp at DravidianLangTech EACL2021 Offensive Language Identification in Dravidian Languages. The paper presents the submission of the team indicnlp kgp to the EACL 2021 shared task "Offensive Language Identification in Dravidian Languages." The task aimed to classify different offensive content types in 3 code mixed Dravidian language datasets. The work leverages existing state of the art approaches in text classification by incorporating additional data and transfer learning on pre trained models. Our final submission is an ensemble of an AWD LSTM based model along with 2 different transformer model architectures based on BERT and RoBERTa. We achieved weighted average F1 scores of 0.97, 0.77, and 0.72 in the Malayalam English, Tamil English, and Kannada English datasets ranking 1st, 2nd, and 3rd on the respective tasks.


Modeling 3D Surface Manifolds with a Locally Conditioned Atlas. Recently proposed 3D object reconstruction methods represent a mesh with an atlas a set of planar patches approximating the surface. However, their application in a real world scenario is limited since the surfaces of reconstructed objects contain discontinuities, which degrades the quality of the final mesh. This is mainly caused by independent processing of individual patches, and in this work, we postulate to mitigate this limitation by preserving local consistency around patch vertices. To that end, we introduce a Locally Conditioned Atlas (LoCondA), a framework for representing a 3D object hierarchically in a generative model. Firstly, the model maps a point cloud of an object into a sphere. Secondly, by leveraging a spherical prior, we enforce the mapping to be locally consistent on the sphere and on the target object. This way, we can sample a mesh quad on that sphere and project it back onto the object's manifold. With LoCondA, we can produce topologically diverse objects while maintaining quads to be stitched together. We show that the proposed approach provides structurally coherent reconstructions while producing meshes of quality comparable to the competitors.


Deductive Verification via the Debug Adapter Protocol. We propose a conceptual integration of deductive program verification into existing user interfaces for software debugging. This integration is well represented in the "Debug Adapter Protocol", a widely used and generic technology to integrate debugging of programs into development environments. Commands like step forward and step in are backed by steps of a symbolic structural operational semantics, and the different paths through a program are readily represented by multiple running threads of the debug target inside the user interface. Thus, existing IDEs can be leveraged for deductive verification debugging with relatively little effort. We have implemented this scheme for SecC, an auto active program verifier for C, and discuss its integration into Visual Studio Code.


Ratios of the Gauss hypergeometric functions with parameters shifted by integers part I. We consider the ratio of two Gauss hypergeometric functions with real parameters shifted by arbitrary integers. We find a formula for the jump of this ratio over the branch cut in terms of a real hypergeometric polynomial, the beta density and the absolute value of the Gauss hypergeometric function. This allows us to construct explicit integral representations for such ratio when the asymptotic behaviour at unity is mild and the denominator does not vanish. Multiplying the ratio by the aforementioned polynomial, we obtain a function that belongs to a generalized Nevanlinna class for arbitrary values of real parameters. We give an in depth analysis of a particular case known as the Gauss ratio. Furthermore, we establish a few general facts relating generalized Nevanlinna classes to Jacobi and Stieltjes continued fractions, as well as to factorization formulae for these classes. The results are illustrated with a large number of examples.


RAILS A Robust Adversarial Immune inspired Learning System. Adversarial attacks against deep neural networks (DNNs) are continuously evolving, requiring increasingly powerful defense strategies. We develop a novel adversarial defense framework inspired by the adaptive immune system the Robust Adversarial Immune inspired Learning System (RAILS). Initializing a population of exemplars that is balanced across classes, RAILS starts from a uniform label distribution that encourages diversity and uses an evolutionary optimization process to adaptively adjust the predictive label distribution in a manner that emulates the way the natural immune system recognizes novel pathogens. RAILS' evolutionary optimization process explicitly captures the tradeoff between robustness (diversity) and accuracy (specificity) of the network, and represents a new immune inspired perspective on adversarial learning. The benefits of RAILS are empirically demonstrated under eight types of adversarial attacks on a DNN adversarial image classifier for several benchmark datasets, including MNIST SVHN CIFAR 10 and CIFAR 10. We find that PGD is the most damaging attack strategy and that for this attack RAILS is significantly more robust than other methods, achieving improvements in adversarial robustness by geq 5.62 , 12.5 , 10.32 , and 8.39 , on these respective datasets, without appreciable loss of classification accuracy. Codes for the results in this paper are available at https github.com wangren09 RAILS.


Landslide Detection in Real Time Social Media Image Streams. Lack of global data inventories obstructs scientific modeling of and response to landslide hazards which are oftentimes deadly and costly. To remedy this limitation, new approaches suggest solutions based on citizen science that requires active participation. However, as a non traditional data source, social media has been increasingly used in many disaster response and management studies in recent years. Inspired by this trend, we propose to capitalize on social media data to mine landslide related information automatically with the help of artificial intelligence (AI) techniques. Specifically, we develop a state of the art computer vision model to detect landslides in social media image streams in real time. To that end, we create a large landslide image dataset labeled by experts and conduct extensive model training experiments. The experimental results indicate that the proposed model can be deployed in an online fashion to support global landslide susceptibility maps and emergency response.


A uniqueness result for the two vortex travelling wave in the Nonlinear Schrodinger equation. For the Nonlinear Schrodinger equation in dimension 2, the existence of a global minimizer of the energy at fixed momentum has been established by Bethuel Gravejat Saut. This minimizer is a travelling wave for the Nonlinear Schrodinger equation. For large momentums, the propagation speed is small and the minimizer behaves like two well separated vortices. In that limit, we show the uniqueness of this minimizer, up to the invariances of the problem, hence proving the orbital stability of this travelling wave. This work is a follow up to two previous papers, where we constructed and studied a particular travelling wave of the equation. We show a uniqueness result on this travelling wave in a class of functions that contains in particular all possible minimizers of the energy.


Training Value Aligned Reinforcement Learning Agents Using a Normative Prior. As more machine learning agents interact with humans, it is increasingly a prospect that an agent trained to perform a task optimally, using only a measure of task performance as feedback, can violate societal norms for acceptable behavior or cause harm. Value alignment is a property of intelligent agents wherein they solely pursue non harmful behaviors or human beneficial goals. We introduce an approach to value aligned reinforcement learning, in which we train an agent with two reward signals a standard task performance reward, plus a normative behavior reward. The normative behavior reward is derived from a value aligned prior model previously shown to classify text as normative or non normative. We show how variations on a policy shaping technique can balance these two sources of reward and produce policies that are both effective and perceived as being more normative. We test our value alignment technique on three interactive text based worlds each world is designed specifically to challenge agents with a task as well as provide opportunities to deviate from the task to engage in normative and or altruistic behavior.


A combinatorial theorem of Schur implies infinitude of primes. Comments about the paper by Elsholz, Fermat's last theorem implies Euclid's infinitude of primes, (2021), and simplification.


Inter subject Deep Transfer Learning for Motor Imagery EEG Decoding. Convolutional neural networks (CNNs) have become a powerful technique to decode EEG and have become the benchmark for motor imagery EEG Brain Computer Interface (BCI) decoding. However, it is still challenging to train CNNs on multiple subjects' EEG without decreasing individual performance. This is known as the negative transfer problem, i.e. learning from dissimilar distributions causes CNNs to misrepresent each of them instead of learning a richer representation. As a result, CNNs cannot directly use multiple subjects' EEG to enhance model performance directly. To address this problem, we extend deep transfer learning techniques to the EEG multi subject training case. We propose a multi branch deep transfer network, the Separate Common Separate Network (SCSN) based on splitting the network's feature extractors for individual subjects. We also explore the possibility of applying Maximum mean discrepancy (MMD) to the SCSN (SCSN MMD) to better align distributions of features from individual feature extractors. The proposed network is evaluated on the BCI Competition IV 2a dataset (BCICIV2a dataset) and our online recorded dataset. Results show that the proposed SCSN (81.8 , 53.2 ) and SCSN MMD (81.8 , 54.8 ) outperformed the benchmark CNN (73.4 , 48.8 ) on both datasets using multiple subjects. Our proposed networks show the potential to utilise larger multi subject datasets to train an EEG decoder without being influenced by negative transfer.


Stability of a numerical scheme for methane transport in hydrate zone under equilibrium and non equilibrium conditions. In this paper we carry out numerical analysis for a family of simplified gas transport models with hydrate formation and dissociation in subsurface, in equilibrium and non equilibrium conditions. These models are adequate for simulation of hydrate phase change at basin and at shorter time scales, but the analysis does not account directly for the related effects of evolving hydraulic properties. To our knowledge this is the first analysis of such a model. It is carried out for the transport steps while keeping the pressure solution fixed. We frame the transport model as conservation law with a non smooth space dependent flux function the kinetic model approximates this equilibrium. We prove weak stability of the upwind scheme applied to the regularized conservation law. We illustrate the model, confirm convergence with numerical simulations, and illustrate its use for some relevant equilibrium and non equilibrium scenarios.


GraphFormers GNN nested Transformers for Representation Learning on Textual Graph. The representation learning on textual graph is to generate low dimensional embeddings for the nodes based on the individual textual features and the neighbourhood information. Recent breakthroughs on pretrained language models and graph neural networks push forward the development of corresponding techniques. The existing works mainly rely on the cascaded model architecture the textual features of nodes are independently encoded by language models at first the textual embeddings are aggregated by graph neural networks afterwards. However, the above architecture is limited due to the independent modeling of textual features. In this work, we propose GraphFormers, where layerwise GNN components are nested alongside the transformer blocks of language models. With the proposed architecture, the text encoding and the graph aggregation are fused into an iterative workflow, making each node's semantic accurately comprehended from the global perspective. In addition, a progressive learning strategy is introduced, where the model is successively trained on manipulated data and original data to reinforce its capability of integrating information on graph. Extensive evaluations are conducted on three large scale benchmark datasets, where GraphFormers outperform the SOTA baselines with comparable running efficiency.


Predicting the success of Gradient Descent for a particular Dataset Architecture Initialization (DAI). Despite their massive success, training successful deep neural networks still largely relies on experimentally choosing an architecture, hyper parameters, initialization, and training mechanism. In this work, we focus on determining the success of standard gradient descent method for training deep neural networks on a specified dataset, architecture, and initialization (DAI) combination. Through extensive systematic experiments, we show that the evolution of singular values of the matrix obtained from the hidden layers of a DNN can aid in determining the success of gradient descent technique to train a DAI, even in the absence of validation labels in the supervised learning paradigm. This phenomenon can facilitate early give up, stopping the training of neural networks which are predicted to not generalize well, early in the training process. Our experimentation across multiple datasets, architectures, and initializations reveals that the proposed scores can more accurately predict the success of a DAI than simply relying on the validation accuracy at earlier epochs to make a judgment.


Asymptotic study of a global solution of super critical Quasi Geostrophic equation. In this paper, we study the super critical Quasi Geostrophic equation in Gevrey Sobolev space. We prove the local existence of (QG) for any large initial data and we give an exponential type of Blow up to the solution. Moreover, we establish the existence global for a small initial data and we show that theta H s a, alpha 1 decays to zero as time goes to infinity. Fourier analysis and standard techniques are used.


Stage Conscious Attention Network (SCAN) A Demonstration Conditioned Policy for Few Shot Imitation. In few shot imitation learning (FSIL), using behavioral cloning (BC) to solve unseen tasks with few expert demonstrations becomes a popular research direction. The following capabilities are essential in robotics applications (1) Behaving in compound tasks that contain multiple stages. (2) Retrieving knowledge from few length variant and misalignment demonstrations. (3) Learning from a different expert. No previous work can achieve these abilities at the same time. In this work, we conduct FSIL problem under the union of above settings and introduce a novel stage conscious attention network (SCAN) to retrieve knowledge from few demonstrations simultaneously. SCAN uses an attention module to identify each stage in length variant demonstrations. Moreover, it is designed under demonstration conditioned policy that learns the relationship between experts and agents. Experiment results show that SCAN can learn from different experts without fine tuning and outperform baselines in complicated compound tasks with explainable visualization.


Generation Challenges Results of the Accuracy Evaluation Shared Task. The Shared Task on Evaluating Accuracy focused on techniques (both manual and automatic) for evaluating the factual accuracy of texts produced by neural NLG systems, in a sports reporting domain. Four teams submitted evaluation techniques for this task, using very different approaches and techniques. The best performing submissions did encouragingly well at this difficult task. However, all automatic submissions struggled to detect factual errors which are semantically or pragmatically complex (for example, based on incorrect computation or inference).


On homology of the MSU spectrum. We give a complete proof the Novikov isomorphism varOmega SU otimes mathbb Z textstyle frac12 cong mathbb Z textstyle frac12 y 2,y 3, ldots , quad mathrm deg y i 2i , where varOmega SU is the SU bordism ring. The proof uses the Adams spectral sequence and a description of the comodule structure of H (MSU mathbb F p) over the dual Steenrod algebra mathfrak A p with odd prime p , which was also missing in the literature.


Lotka's Law and Pattern of Author Productivity in the Field of Brain Concussion Research A Scientometric Analysis. The present study deals a scientometric analysis of 8486 bibliometric publications retrieved from the Web of Science database during the period 2008 to 2017. Data is collected and analyzed using Bibexcel software. The study focuses on various aspect of the quantitative research such as growth of papers (year wise), Collaborative Index (CI), Degree of Collaboration (DC), Co authorship Index (CAI), Collaborative Co efficient (CC), Modified Collaborative Co Efficient (MCC), Lotka's Exponent value, Kolmogorov Smirnov test (K S Test).


The anatomy of Boris type solvers and large time step plasma simulations. This work gives a Lie operator derivation of various Boris solvers via a detailed study of first and second order trajectory errors in a constant magnetic field. These errors in the gyro circle center and gyro radius are the foundational basis for why Boris solvers existed, independent of any finite difference schemes. The elimination of these errors then forces the second order solver's trajectory to be exactly on the gyro circle. By revisiting some historical calculations, it is found that many publications do not distinguish the poorly behaved first order leap frog solver with the correct second order Boris algorithm. This work shows that this second order Boris solver is much more accurate then previously thought and that its trajectory remains close to the exact orbit in a combined nonuniform electric and magnetic field at time steps greater than the cyclotron period.


Replication initiation in E. coli is regulated via an origin density sensor generating adder correlations. All living cells need to coordinate DNA replication with growth and division to generate cell cycles that are stable in time. The bacterium Escherichia coli initiates replication at a volume per origin that on average is independent of the growth rate. It also adds an on average constant volume per origin between successive initiation events, independent of the initiation size. Yet, a molecular model that can explain these observations has been lacking. Here, we develop a mathematical model of DNA replication initiation in E. coli that is consistent with a wealth of experimental data. We first show that the previously proposed initiator titration model, which is based on the accumulation of the initiator protein DnaA on chromosomal titration sites, is insufficient to explain the experimental findings. We then present a model that is based on an ultra sensitive switch between an inactive form of DnaA and an active form that induces replication initiation. Our model shows that at low growth rates the switch is predominantly controlled by activation of DnaA via lipids and deactivation via the chromosomal site datA, while at high growth rates DARS2 and RIDA become essential. Crucially, in our mean field model DNA replication is initiated at a constant volume per origin, qualifying our model as a sizer. Yet, we show that in a stochastic version of the same model the inevitable fluctuations in the components that control the DnaA activation switch naturally give rise to the experimentally observed adder correlations.


A geometric dynamical system with relation to polygonal billiards. We introduce a geometric dynamical system where iteration is defined as a cycling composition of a finite collection of geometric maps, which act on a space composed of three or more nonparallel, nonconcurrent lines in mathbb R 2 . This system is motivated by the dynamics of iterated function systems, as well as billiards with modified reflection laws. We provide conditions under which this dynamical system generates periodic orbits, and use this result to prove the existence of closed nonsmooth curves over mathbb R 2 which satisfy particular structural constraints with respect to a space of intersecting lines in the plane.


Video Surveillance for Road Traffic Monitoring. This paper presents the learned techniques during the Video Analysis Module of the Master in Computer Vision from the Universitat Aut onoma de Barcelona, used to solve the third track of the AI City Challenge. This challenge aims to track vehicles across multiple cameras placed in multiple intersections spread out over a city. The methodology followed focuses first in solving multi tracking in a single camera and then extending it to multiple cameras. The qualitative results of the implemented techniques are presented using standard metrics for video analysis such as mAP for object detection and IDF1 for tracking. The source code is publicly available at https github.com mcv m6 video mcv m6 2021 team4.


Secure Platform for Processing Sensitive Data on Shared HPC Systems. High performance computing clusters operating in shared and batch mode pose challenges for processing sensitive data. In the meantime, the need for secure processing of sensitive data on HPC system is growing. In this work we present a novel method for creating secure computing environments on traditional multi tenant high performance computing clusters. Our platform as a service provides a customizable, virtualized solution using PCOCC and SLURM to meet strict security requirements without modifying the exist ing HPC infrastructure. We show how this platform has been used in real world research applications from different research domains. The solution is scalable by design with low performance overhead and can be generalized for processing sensitive data on shared HPC systems imposing high security criteria


Aldosterone and Dexamethasone Activate African Lungfish Mineralocorticoid Receptor Increased Activation After Removal of the Amino Terminal Domain. Aldosterone, the main physiological mineralocorticoid in humans and other terrestrial vertebrates, first appears in lungfish, which are lobe finned fish that are forerunners of terrestrial vertebrates. Aldosterone activation of the MR regulates internal homeostasis of water, sodium and potassium, which was critical in the conquest of land by vertebrates. We studied transcriptional activation of the slender African lungfish MR by aldosterone, other corticosteroids and progesterone and find that aldosterone, 11 deoxycorticosterone, 11 deoxycortisol and progesterone have half maximal responses (EC50s) below 1 nM and are potential physiological mineralocorticoids. In contrast, EC50s for corticosterone and cortisol were 23 nM and 66 nM, respectively. Unexpectedly, truncated lungfish MR, consisting of the DNA binding, hinge and steroid binding domains, had a stronger response to corticosteroids and progesterone than full length lungfish MR, indicating that the N terminal domain represses steroid activation of lungfish MR, unlike human MR in which the N terminal domain contains an activation function. BLAST searches of GenBank did not retrieve a GR ortholog, leading us to test dexamethasone and triamcinolone for activation of lungfish MR. At 10 nM, both synthetic glucocorticoids are about 4 fold stronger than 10 nM aldosterone in activating full length lungfish MR, leading us to propose that lungfish MR also functions as a GR.


Randomized Deep Structured Prediction for Discourse Level Processing. Expressive text encoders such as RNNs and Transformer Networks have been at the center of NLP models in recent work. Most of the effort has focused on sentence level tasks, capturing the dependencies between words in a single sentence, or pairs of sentences. However, certain tasks, such as argumentation mining, require accounting for longer texts and complicated structural dependencies between them. Deep structured prediction is a general framework to combine the complementary strengths of expressive neural encoders and structured inference for highly structured domains. Nevertheless, when the need arises to go beyond sentences, most work relies on combining the output scores of independently trained classifiers. One of the main reasons for this is that constrained inference comes at a high computational cost. In this paper, we explore the use of randomized inference to alleviate this concern and show that we can efficiently leverage deep structured prediction and expressive neural encoders for a set of tasks involving complicated argumentative structures.


A Machine Learning model of the combination of normalized SD1 and SD2 indexes from 24h Heart Rate Variability as a predictor of myocardial infarction. Aim to evaluate the ability of the nonlinear 24 HRV as a predictor of MI using Machine Learning Methods The sample was composed of 218 patients divided into two groups (Healthy, n 128 MI n 90). The sample dataset is part of the Telemetric and Holter Electrocardiogram Warehouse (THEW) database, from the University of Rochester Medical Center. We used the most common ML algorithms for accuracy comparison with a setting of 10 fold cross validation (briefly, Linear Regression, Linear Discriminant Analysis, k Nearest Neighbour, Random Forest, Supporting Vector Machine, Na "ive Bayes, C 5.0 and Stochastic Gradient Boosting). Results The main findings of this study show that the combination of SD1nu SD2nu has greater predictive power for MI in comparison to other HRV indexes. Conclusion The ML model using nonlinear HRV indexes showed to be more effective than the linear domain, evidenced through the application of ML, represented by a good precision of the Stochastic Gradient Boosting model. Keywords heart rate variability, machine learning, nonlinear domain, cardiovascular disease


Domain Adversarial Neural Networks for Domain Generalization When It Works and How to Improve. Theoretically, domain adaptation is a well researched problem. Further, this theory has been well used in practice. In particular, we note the bound on target error given by Ben David et al. (2010) and the well known domain aligning algorithm based on this work using Domain Adversarial Neural Networks (DANN) presented by Ganin and Lempitsky (2015). Recently, multiple variants of DANN have been proposed for the related problem of domain generalization, but without much discussion of the original motivating bound. In this paper, we investigate the validity of DANN in domain generalization from this perspective. We investigate conditions under which application of DANN makes sense and further consider DANN as a dynamic process during training. Our investigation suggests that the application of DANN to domain generalization may not be as straightforward as it seems. To address this, we design an algorithmic extension to DANN in the domain generalization case. Our experimentation validates both theory and algorithm.


End to End Video Question Answer Generation with Generator Pretester Network. We study a novel task, Video Question Answer Generation (VQAG), for challenging Video Question Answering (Video QA) task in multimedia. Due to expensive data annotation costs, many widely used, large scale Video QA datasets such as Video QA, MSVD QA and MSRVTT QA are automatically annotated using Caption Question Generation (CapQG) which inputs captions instead of the video itself. As captions neither fully represent a video, nor are they always practically available, it is crucial to generate question answer pairs based on a video via Video Question Answer Generation (VQAG). Existing video to text (V2T) approaches, despite taking a video as the input, only generate a question alone. In this work, we propose a novel model Generator Pretester Network that focuses on two components (1) The Joint Question Answer Generator (JQAG) which generates a question with its corresponding answer to allow Video Question "Answering" training. (2) The Pretester (PT) verifies a generated question by trying to answer it and checks the pretested answer with both the model's proposed answer and the ground truth answer. We evaluate our system with the only two available large scale human annotated Video QA datasets and achieves state of the art question generation performances. Furthermore, using our generated QA pairs only on the Video QA task, we can surpass some supervised baselines. We apply our generated questions to Video QA applications and surpasses some supervised baselines using generated questions only. As a pre training strategy, we outperform both CapQG and transfer learning approaches when employing semi supervised (20 ) or fully supervised learning with annotated data. These experimental results suggest the novel perspectives for Video QA training.


Long Span Summarization via Local Attention and Content Selection. Transformer based models have achieved state of the art results in a wide range of natural language processing (NLP) tasks including document summarization. Typically these systems are trained by fine tuning a large pre trained model to the target task. One issue with these transformer based models is that they do not scale well in terms of memory and compute requirements as the input length grows. Thus, for long document summarization, it can be challenging to train or fine tune these models. In this work, we exploit large pre trained transformer based models and address long span dependencies in abstractive summarization using two methods local self attention and explicit content selection. These approaches are compared on a range of network configurations. Experiments are carried out on standard long span summarization tasks, including Spotify Podcast, arXiv, and PubMed datasets. We demonstrate that by combining these methods, we can achieve state of the art results on all three tasks in the ROUGE scores. Moreover, without a large scale GPU card, our approach can achieve comparable or better results than existing approaches.


Self supervised Low Light Image Enhancement and Denoising. This paper proposes a self supervised low light image enhancement method based on deep learning, which can improve the image contrast and reduce noise at the same time to avoid the blur caused by pre post denoising. The method contains two deep sub networks, an Image Contrast Enhancement Network (ICE Net) and a Re Enhancement and Denoising Network (RED Net). The ICE Net takes the low light image as input and produces a contrast enhanced image. The RED Net takes the result of ICE Net and the low light image as input, and can re enhance the low light image and denoise at the same time. Both of the networks can be trained with low light images only, which is achieved by a Maximum Entropy based Retinex (ME Retinex) model and an assumption that noises are independently distributed. In the ME Retinex model, a new constraint on the reflectance image is introduced that the maximum channel of the reflectance image conforms to the maximum channel of the low light image and its entropy should be the largest, which converts the decomposition of reflectance and illumination in Retinex model to a non ill conditioned problem and allows the ICE Net to be trained with a self supervised way. The loss functions of RED Net are carefully formulated to separate the noises and details during training, and they are based on the idea that, if noises are independently distributed, after the processing of smoothing filters ( eg mean filter), the gradient of the noise part should be smaller than the gradient of the detail part. It can be proved qualitatively and quantitatively through experiments that the proposed method is efficient.


Self organization of oscillation in an epidemic model for COVID 19. On the basis of a compartment model, the epidemic curve is investigated when the net rate lambda of change of the number of infected individuals I is given by an ellipse in the lambda I plane which is supported in I ell , I h . With a equiv (I h I ell ) (I h I ell ) , it is shown that (1) when a 1 or I ell 0 , oscillation of the infection curve is self organized and the period of the oscillation is in proportion to the ratio of the difference (I h I ell ) and the geometric mean sqrt I h I ell of I h and I ell , (2) when a 1 , the infection curve shows a critical behavior where it decays obeying a power law function with exponent 2 in the long time limit after a peak, and (3) when a 1 , the infection curve decays exponentially in the long time limit after a peak. The present result indicates that the pandemic can be controlled by a measure which makes I ell 0 .


Can We Replicate Real Human Behaviour Using Artificial Neural Networks?. Agent based modelling is a powerful tool when simulating human systems, yet when human behaviour cannot be described by simple rules or maximising one's own profit, we quickly reach the limits of this methodology. Machine learning has the potential to bridge this gap by providing a link between what people observe and how they act in order to reach their goal. In this paper we use a framework for agent based modelling that utilizes human values like fairness, conformity and altruism. Using this framework we simulate a public goods game and compare to experimental results. We can report good agreement between simulation and experiment and furthermore find that the presented framework outperforms strict reinforcement learning. Both the framework and the utility function are generic enough that they can be used for arbitrary systems, which makes this method a promising candidate for a foundation of a universal agent based model.


Twisted Composition Algebras and Arthur Packets for Triality Spin(8). Using exceptional theta correspondences we construct a family of Arthur packets for the exceptional group of type D4, and establish the global Arthur multiplicity formula.


Three decompositions of symmetric tensors have similar condition numbers. We relate the condition numbers of computing three decompositions of symmetric tensors the canonical polyadic decomposition, the Waring decomposition, and a Tucker compressed Waring decomposition. Based on this relation we can speed up the computation of these condition numbers by orders of magnitude


Irregular Subgraphs. We suggest two related conjectures dealing with the existence of spanning irregular subgraphs of graphs. The first asserts that any d regular graph on n vertices contains a spanning subgraph in which the number of vertices of each degree between 0 and d deviates from frac n d 1 by at most 2 . The second is that every graph on n vertices with minimum degree delta contains a spanning subgraph in which the number of vertices of each degree does not exceed frac n delta 1 2 . Both conjectures remain open, but we prove several asymptotic relaxations for graphs with a large number of vertices n . In particular we show that if d 3 log n leq o(n) then every d regular graph with n vertices contains a spanning subgraph in which the number of vertices of each degree between 0 and d is (1 o(1)) frac n d 1 . We also prove that any graph with n vertices and minimum degree delta contains a spanning subgraph in which no degree is repeated more than (1 o(1)) frac n delta 1 2 times.


GRIM A General, Real Time Deep Learning Inference Framework for Mobile Devices based on Fine Grained Structured Weight Sparsity. It is appealing but challenging to achieve real time deep neural network (DNN) inference on mobile devices because even the powerful modern mobile devices are considered as resource constrained'' when executing large scale DNNs. It necessitates the sparse model inference via weight pruning, i.e., DNN weight sparsity, and it is desirable to design a new DNN weight sparsity scheme that can facilitate real time inference on mobile devices while preserving a high sparse model accuracy. This paper designs a novel mobile inference acceleration framework GRIM that is General to both convolutional neural networks (CNNs) and recurrent neural networks (RNNs) and that achieves Real time execution and high accuracy, leveraging fine grained structured sparse model Inference and compiler optimizations for Mobiles. We start by proposing a new fine grained structured sparsity scheme through the Block based Column Row (BCR) pruning. Based on this new fine grained structured sparsity, our GRIM framework consists of two parts (a) the compiler optimization and code generation for real time mobile inference and (b) the BCR pruning optimizations for determining pruning hyperparameters and performing weight pruning. We compare GRIM with Alibaba MNN, TVM, TensorFlow Lite, a sparse implementation based on CSR, PatDNN, and ESE (a representative FPGA inference acceleration framework for RNNs), and achieve up to 14.08x speedup.


Real powers of monomial ideals. This paper concerns the exponentiation of monomial ideals. While it is customary for the exponentiation operation on ideals to consider natural powers, we extend this notion to powers where the exponent is a positive real number. Real powers of a monomial ideal generalize the integral closure operation and highlight many interesting connections to the theory of convex polytopes. We provide multiple algorithms for computing the real powers of a monomial ideal. An important result is that given any monomial ideal I , the function taking real numbers to the corresponding real power of I is a step function whose jumping points are rational. This reduces the problem of determining real powers to rational exponents.


Enhancing Goos H "anchen shift based on magnetic dipole quasi bound states in the continuum in all dielectric metasurfaces. Metasurface mediated bound states in the continuum (BIC) provides a versatile platform for light manipulation at subwavelength dimension with diverging radiative quality factor and extreme optical localization. In this work, we employ magnetic dipole quasi BIC resonance in asymmetric silicon nanobar metasurfaces to realize giant Goos H "anchen (GH) shift enhancement by more than three orders of wavelength. In sharp contrast to GH shift based on the Brewster dip or transmission type resonance, the maximum GH shift here is located at the reflection peak with unity reflectance, which can be conveniently detected in the experiment. By adjusting the asymmetric parameter of metasurfaces, the Q factor and GH shift can be modulated accordingly. More interestingly, it is found that GH shift exhibits an inverse quadratic dependence on the asymmetric parameter. Furthermore, we design an ultrasensitive environmental refractive index sensor based on the quasi BIC enhanced GH shift, with a maximum sensitivity of 1.5 times 10 7 mu m RIU. Our work not only reveals the essential role of BIC in engineering the basic optical phenomena, but also suggests the way for pushing the performance limits of optical communication devices, information storage, wavelength division de multiplexers, and ultrasensitive sensors.


Fast Splitting Algorithms for Sparsity Constrained and Noisy Group Testing. In group testing, the goal is to identify a subset of defective items within a larger set of items based on tests whose outcomes indicate whether at least one defective item is present. This problem is relevant in areas such as medical testing, DNA sequencing, communication protocols, and many more. In this paper, we study (i) a sparsity constrained version of the problem, in which the testing procedure is subjected to one of the following two constraints items are finitely divisible and thus may participate in at most gamma tests or tests are size constrained to pool no more than rho items per test and (ii) a noisy version of the problem, where each test outcome is independently flipped with some constant probability. Under each of these settings, considering the for each recovery guarantee with asymptotically vanishing error probability, we introduce a fast splitting algorithm and establish its near optimality not only in terms of the number of tests, but also in terms of the decoding time. While the most basic formulations of our algorithms require Omega(n) storage for each algorithm, we also provide low storage variants based on hashing, with similar recovery guarantees.


Coupling fully resolved light particles with the Lattice Boltzmann method on adaptively refined grids. The simulation of geometrically resolved rigid particles in a fluid relies on coupling algorithms to transfer momentum both ways between the particles and the fluid. In this article, the fluid flow is modeled with a parallel Lattice Boltzmann method using adaptive grid refinement to improve numerical efficiency. The coupling with the particles is realized with the momentum exchange method. When implemented in plain form, instabilities may arise in the coupling when the particles are lighter than the fluid. The algorithm can be stabilized with a virtual mass correction specifically developed for the Lattice Boltzmann method. The method is analyzed for a wide set of physically relevant regimes, varying independently the body to fluid density ratio and the relative magnitude of inertial and viscous effects. These studies of a single rising particle exhibit periodic regimes of particle motion as well as chaotic behavior, as previously reported in the literature. The new method is carefully compared with available experimental and numerical results. This serves to validate the presented new coupled Lattice Boltzmann method and additionally it leads to new physical insight for some of the parameter settings.


n Kazhdan groups and higher spectral expanders. Let Gamma be a group of type F n and let X be the n skeleton of the universal cover of a K( Gamma,1) simplicial complex with finite n skeleton. We show that if Gamma is strongly n Kazhdan, then for any family of finite index subgroups Lambda i i , the family of simplicial complexes Lambda i backslash X i are bounded degree n dimensional spectral expanders. Using this we construct new examples of 2 dimensional spectral expanders.


Does your robot know? Enhancing children's information retrieval through spoken conversation with responsible robots. In this paper, we identify challenges in children's current information retrieval process, and propose conversational robots as an opportunity to ease this process in a responsible way. Tools children currently use in this process, such as search engines on a computer or voice agents, do not always meet their specific needs. The conversational robot we propose maintains context, asks clarifying questions, and gives suggestions in order to better meet children's needs. Since children are often too trusting of robots, we propose to have the robot measure, monitor and adapt to the trust the child has in the robot. This way, we hope to induce a critical attitude with the children during their information retrieval process.


Automated Symbolic and Numerical Testing of DLMF Formulae using Computer Algebra Systems. We have developed an automated procedure for symbolic and numerical testing of formulae extracted from the NIST Digital Library of Mathematical Functions (DLMF). For the NIST Digital Repository of Mathematical Formulae, we have developed conversion tools from semantic LaTeX to the Computer Algebra System (CAS) Maple which relies on Youssef's part of math tagger. We convert a test data subset of 4,078 semantic LaTeX DLMF formulae extracted from the DLMF to the native CAS representation and then apply an automated scheme for symbolic and numerical testing and verification. Our framework is implemented using Java and Maple. We describe in detail the conversion process which is required so that the CAS can correctly interpret the mathematical representation of the formulae. We describe the improvement of the effectiveness of our automated scheme through incremental enhancement (making more precise) of the mathematical semantic markup for the formulae.


Efficient Self Supervised Data Collection for Offline Robot Learning. A practical approach to robot reinforcement learning is to first collect a large batch of real or simulated robot interaction data, using some data collection policy, and then learn from this data to perform various tasks, using offline learning algorithms. Previous work focused on manually designing the data collection policy, and on tasks where suitable policies can easily be designed, such as random picking policies for collecting data about object grasping. For more complex tasks, however, it may be difficult to find a data collection policy that explores the environment effectively, and produces data that is diverse enough for the downstream task. In this work, we propose that data collection policies should actively explore the environment to collect diverse data. In particular, we develop a simple yet effective goal conditioned reinforcement learning method that actively focuses data collection on novel observations, thereby collecting a diverse data set. We evaluate our method on simulated robot manipulation tasks with visual inputs and show that the improved diversity of active data collection leads to significant improvements in the downstream learning tasks.


A Psh Hopf Lemma for Domains with Cusp Conditions. We obtain a psh Hopf lemma for domains satisfying certain cusp conditions by using a sharp estimate for the Green function of a planar cusp along the axis. As an application, we obtain a negative psh exhaustion function with certain global growth estimate on a pseudoconvex domain with H " o lder boundary.


High speed programmable photonic circuits in a cryogenically compatible, visible NIR 200 mm CMOS architecture. Recent advances in photonic integrated circuits (PICs) have enabled a new generation of "programmable many mode interferometers" (PMMIs) realized by cascaded Mach Zehnder Interferometers (MZIs) capable of universal linear optical transformations on N input output optical modes. PMMIs serve critical functions in photonic quantum information processing, quantum enhanced sensor networks, machine learning and other applications. However, PMMI implementations reported to date rely on thermo optic phase shifters, which limit applications due to slow response times and high power consumption. Here, we introduce a large scale PMMI platform, based on a 200 mm CMOS process, that uses aluminum nitride (AlN) piezo optomechanical actuators coupled to silicon nitride (SiN) waveguides, enabling low loss propagation with phase modulation at greater than 100 MHz in the visible to near infrared wavelengths. Moreover, the vanishingly low holding power consumption of the piezo actuators enables these PICs to operate at cryogenic temperatures, paving the way for a fully integrated device architecture for a range of quantum applications.


Characterising Fixed Parameter Tractability of Query Evaluation over Guarded TGDs. We study the parameterized complexity of evaluating Ontology Mediated Queries (OMQs) based on Guarded TGDs (GTGDs) and Unions of Conjunctive Queries (UCQs), in the case where relational symbols have unrestricted arity and where the parameter is the size of the OMQ. We establish exact criteria for fixed parameter tractability (fpt) evaluation of recursively enumerable classes of such OMQs (under the widely held Exponential Time Hypothesis). One of the main technical tools introduced in the paper is an fpt reduction from deciding parameterized uniform CSPs to parameterized OMQ evaluation. The reduction preserves measures which are known to be essential for classifying recursively enumerable classes of parameterized uniform CSPs submodular width (according to the well known result of Marx for unrestricted arity schemas) and treewidth (according to the well known result of Grohe for bounded arity schemas). As such, it can be employed to obtain hardness results for evaluation of recursively enumerable classes of parameterized OMQs both in the unrestricted and in the bounded arity case. Previously, in the case of bounded arity schemas, this has been tackled using a technique requiring full introspection into the construction employed by Grohe.


How to Deal with Fake News Visualizing Disinformation. The current public sense of anxiety in dealing with disinformation as manifested by so called fake news is acutely displayed by the reaction to recent events prompted by a belief in conspiracies among certain groups. A model to deal with disinformation is proposed it is based on a demonstration of the analogous behavior of disinformation to that of wave phenomena. Two criteria form the basis to combat the deleterious effects of disinformation the use of a refractive medium based on skepticism as the default mode, and polarization as a filter mechanism to analyze its merits based on evidence. Critical thinking is enhanced since the first one tackles the pernicious effect of the confirmation bias, and the second the tendency towards attribution, both of which undermine our efforts to think and act rationally. The benefits of such a strategy include an epistemic reformulation of disinformation as an independently existing phenomenon, that removes its negative connotations when perceived as being possessed by groups or individuals.


PeCLR Self Supervised 3D Hand Pose Estimation from monocular RGB via Contrastive Learning. Encouraged by the success of contrastive learning on image classification tasks, we propose a new self supervised method for the structured regression task of 3D hand pose estimation. Contrastive learning makes use of unlabeled data for the purpose of representation learning via a loss formulation that encourages the learned feature representations to be invariant under any image transformation. For 3D hand pose estimation, it too is desirable to have invariance to appearance transformation such as color jitter. However, the task requires equivariance under affine transformations, such as rotation and translation. To address this issue, we propose an equivariant contrastive objective and demonstrate its effectiveness in the context of 3D hand pose estimation. We experimentally investigate the impact of invariant and equivariant contrastive objectives and show that learning equivariant features leads to better representations for the task of 3D hand pose estimation. Furthermore, we show that standard ResNets with sufficient depth, trained on additional unlabeled data, attain improvements of up to 14.5 in PA EPE on FreiHAND and thus achieves state of the art performance without any task specific, specialized architectures. Code and models are available at https ait.ethz.ch projects 2021 PeCLR


Reducing Moser's Square Packing Problem to a Bounded Number of Squares. The problem widely known as Moser's Square Packing Problem asks for the smallest area A such that for any set S of squares of total area 1 , there exists a rectangle R of area A into which the squares in S permit an internally disjoint, axis parallel packing. It was formulated by Moser in 1966 and remains unsolved so far. The best known lower bound of frac 2 sqrt 3 3 leq A is due to Novotn 'y and has been shown to be sufficient for up to 11 squares by Platz, while Hougardy and Ilhan have established that A 1.37 . In this paper, we reduce Moser's Square Packing Problem to a problem on a finite set of squares in the following sense We show how to compute a natural number N such that it is enough to determine the value of A for sets containing at most N squares with total area 1 .


Intercross An Android app for plant breeding and genetics cross management. Plant breeding is fundamentally comprised of three cyclic activities 1) intermating lines to generate novel allelic combinations, 2) evaluation of new plant cultivars in distinct environments, and 3) selection of superior individuals to be used as parents in the next breeding cycle. While digital technologies and tools are commonly utilized for the latter two stages, many plant research programs still rely on manual annotation and paper tags to track the crosses that constitute the basis of a plant breeding program. This presence of analog data is a crack in the foundation of a digital breeding ecosystem and a significant occasion for errors to be introduced that will propagate through the entire breeding program. However, implementing digital cross tracking into breeding programs is difficult due to the non standardized workflows that different breeders have adopted. Intercross, an open source Android app, aims to provide scientists with a robust and simple solution for planning, tracking, and managing the crosses being made each season and aims to serve as the primary tool to digitize crossing data for breeding programs. The simplicity and flexibility of Intercross allows rapid and broad adoption by diverse breeding programs and will solidify the concepts of a digital breeding ecosystem.


Shortening X ray Pulse Duration via Saturable Absorption. To shorten the duration of x ray pulses, we present a nonlinear optical technique using atoms with core hole vacancies (core hole atoms) generated by inner shell photoionization. The weak Coulomb screening in the core hole atoms results in decreased absorption at photon energies immediately above the absorption edge. By employing this phenomenon, referred to as saturable absorption, we successfully reduce the duration of x ray free electron laser pulses (photon energy 9.000 keV, duration 6 7 fs, fluence 2.0 3.5 times 10 5 J cm 2 ) by sim 35 . This finding that core hole atoms are applicable to nonlinear x ray optics is an essential stepping stone for extending nonlinear technologies commonplace at optical wavelengths to the hard x ray region.